-- Logs begin at Mon 2020-12-21 03:19:17 UTC, end at Mon 2020-12-21 04:53:02 UTC. -- Dec 21 03:54:41.305385 dv-cinder-733062-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 21 03:54:41.313399 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: *** Starting uWSGI 2.0.15-debian (64bit) on [Mon Dec 21 03:54:41 2020] *** Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: nodename: dv-cinder-733062-17-iscsi Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: machine: x86_64 Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: clock source: unix Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: pcre jit disabled Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: detected number of CPU cores: 4 Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: current working directory: / Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: detected binary path: /usr/bin/uwsgi-core Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: dropping root privileges as early as possible Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: your processes number limit is 47843 Dec 21 03:54:41.315513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: your memory page size is 4096 bytes Dec 21 03:54:41.316684 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: detected max file descriptor number: 2048 Dec 21 03:54:41.316684 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: lock engine: pthread robust mutexes Dec 21 03:54:41.316684 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: thunder lock: enabled Dec 21 03:54:41.316684 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 21 03:54:41.316684 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: dropping root privileges after socket binding Dec 21 03:54:41.316684 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Dec 21 03:54:41.362682 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: Python main interpreter initialized at 0x55814ed809c0 Dec 21 03:54:41.362682 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: dropping root privileges after plugin initialization Dec 21 03:54:41.362682 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: python threads support enabled Dec 21 03:54:41.362682 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: your server socket listen backlog is limited to 100 connections Dec 21 03:54:41.362682 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: your mercy for graceful operations on workers is 90 seconds Dec 21 03:54:41.363205 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: mapped 402621 bytes (393 KB) for 2 cores Dec 21 03:54:41.363205 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: *** Operational MODE: preforking *** Dec 21 03:54:41.363378 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: dropping root privileges after application loading Dec 21 03:54:41.363378 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: *** uWSGI is running in multiple interpreter mode *** Dec 21 03:54:41.363378 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: spawned uWSGI master process (pid: 79610) Dec 21 03:54:41.363482 dv-cinder-733062-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 21 03:54:41.363865 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: spawned uWSGI worker 1 (pid: 79611, cores: 1) Dec 21 03:54:41.364147 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: spawned uWSGI worker 2 (pid: 79612, cores: 1) Dec 21 03:54:41.364243 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 21 03:54:45.798040 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 21 03:54:45.798603 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 21 03:54:45.799910 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 21 03:54:45.800336 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 21 03:54:45.800625 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 21 03:54:45.801081 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.801445 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.801806 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.801923 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 21 03:54:45.802115 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 21 03:54:45.802218 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.802512 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.802861 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.803244 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.803598 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.803705 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 21 03:54:45.803967 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.804075 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 21 03:54:45.804259 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.804371 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 21 03:54:45.804617 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.804781 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.804979 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-17-iscsi {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.805154 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.805343 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.805523 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.805683 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.805912 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.806074 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.806269 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.806370 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.806630 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.806788 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.807019 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.807139 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.807354 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.807463 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.807734 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.807961 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.808074 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.808351 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.808464 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.808692 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.808980 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-17-iscsi {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.809087 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.809358 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.809464 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.809708 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.809817 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.810051 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.810158 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.810410 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.810516 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.810754 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.810861 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.811139 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.811247 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.811480 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.811594 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.811841 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-17-iscsi {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.812091 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.812206 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.812447 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.812547 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.812798 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.812899 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.813153 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.813262 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.813543 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.813651 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.813902 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.814007 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.814253 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.814360 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.814615 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.814722 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.814980 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.815096 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.815347 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.815448 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.815693 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.815801 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.816054 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.816223 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-17-iscsi {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.816398 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.816537 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.816729 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.816901 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.817083 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.817236 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.817388 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.817538 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.817702 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.817870 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.818033 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.818195 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.818358 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.818530 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.818681 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.818839 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.819027 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.819223 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.819390 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.819604 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.819772 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.819942 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.820106 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.820268 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.820419 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.820589 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.820751 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.820918 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.821089 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.821251 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.821417 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.821580 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.821748 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.821911 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.822062 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.822228 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.822392 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.822545 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.822707 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.822869 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.823007 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.823118 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.823222 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.823329 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.823555 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.823656 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.824026 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.824210 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.824367 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.824494 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.824714 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.824823 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.825004 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.825112 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.825375 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.825481 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.825753 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.825860 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.826070 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.826171 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.826413 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.826566 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.826757 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.826891 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.827134 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.827243 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.827480 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.827580 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.827824 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.827937 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.828175 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.828276 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.828509 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.828616 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.828849 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.828971 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.829188 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.829295 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.829547 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.829647 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.829893 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.830002 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.830224 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.830331 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.830504 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.830692 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.830837 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.831031 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.831200 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.831384 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.831556 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.831776 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.831883 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.832146 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.832248 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.832498 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.832599 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.832829 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.832939 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.833166 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.833275 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.833506 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.833608 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.833843 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.833955 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.834180 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.834282 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.834517 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.834626 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.834853 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.834983 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.835222 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.835324 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.835501 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.835603 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.835846 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.835956 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.836194 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.836295 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.836544 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.836677 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.836885 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.837018 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.837217 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.837320 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.837554 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.837661 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.837889 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.837996 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.838236 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.838337 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.838567 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.838679 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.838946 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.839052 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.839270 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.839377 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.840138 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.840296 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.840484 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.840660 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.840831 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.841025 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.841178 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.841368 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.841522 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.841710 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.841890 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.842066 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.842259 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.842372 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.842610 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.842716 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.842996 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.843110 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.843346 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.843454 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.843693 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.843800 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.844022 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.844128 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.844358 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.844470 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.844700 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.844800 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.845036 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.845142 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.845370 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.845478 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.845704 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.845806 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.846035 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.846143 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.846385 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.846527 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.846733 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.846842 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.847093 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.847195 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.847434 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.847536 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.847770 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.847882 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.848126 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.848228 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.848466 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.848567 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.848812 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.848920 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.849155 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.849257 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.849499 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.849604 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.849839 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.849947 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.850189 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.850290 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.850530 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.850631 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.850868 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.851066 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.851228 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.851341 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.851585 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.851691 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.851929 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.852031 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.852273 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.852384 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.852614 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.852715 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.852949 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.853057 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.853299 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.853409 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 03:54:45.853667 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.853768 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.854017 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.854118 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.854364 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.854476 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.854717 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.854826 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.855681 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.855872 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.856119 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.856246 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.856420 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.856582 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.856778 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.856926 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.857137 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.857241 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.857511 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.857612 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.858127 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.858244 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.858480 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.858588 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.858834 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.858955 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.859230 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.859333 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.859592 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.859709 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.859946 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.860047 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.860296 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.860398 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.860643 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.860744 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.860994 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.861095 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.861334 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.861436 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.861687 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.861789 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.862033 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.862143 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.862383 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.862485 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.862753 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.862974 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.863077 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.863188 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.863408 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.863516 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.863752 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.863853 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.864093 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.864193 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.864450 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.864550 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.864817 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.864926 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.865157 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.865264 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.865533 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.865643 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.865866 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.865968 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.866209 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.866318 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.866555 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.866664 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.866894 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.867034 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.867265 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.867366 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.867608 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.867709 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.867947 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.868055 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.868291 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.868392 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.868628 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.868729 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.868967 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.869069 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.869310 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.869412 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.869643 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.869756 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.869982 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.870083 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.870330 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.870437 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.870724 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.870839 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.871153 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.871327 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.871502 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.871870 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.872223 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.872573 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.872949 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.873187 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.873331 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.873559 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.873670 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.873921 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.874030 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.874287 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.874389 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.874650 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.874752 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.875013 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.875133 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.875364 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.875465 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.875711 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.876054 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.876399 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.876840 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.878414 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.878532 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.878637 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.878745 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.878851 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.878974 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.879075 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.879172 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.879280 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.879386 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.879386 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.879386 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.879680 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.879971 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.880312 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.880435 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.880700 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.880803 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.881041 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.881142 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.881420 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.881521 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.881768 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.881869 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.882129 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.882230 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.882485 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.882595 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.882838 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.882959 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.883209 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.883312 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.883552 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.883653 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.883898 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.883998 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.884262 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.884363 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.884605 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.884709 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.884950 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.885051 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.885289 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.885397 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.885634 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.885736 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.885989 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.886089 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.886384 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.886499 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.886818 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.886966 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.887198 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.887321 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.887549 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.887681 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.887893 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.888005 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.888240 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.888350 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.888581 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.888700 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.888928 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.889039 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.889270 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.889380 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.889610 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.889729 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.889955 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.890064 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.890298 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.890415 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.890644 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.890769 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.891012 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.891134 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.891356 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.891457 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.891708 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.891810 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.892053 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.892159 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.892393 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.892493 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.892736 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.892838 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.893084 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.893186 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.893429 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.893530 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.893769 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.893878 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.894126 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.894227 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.894472 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.894579 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.894806 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.894961 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.895170 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.895271 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.895523 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.895634 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.895861 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.895963 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.896202 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.896310 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.896541 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.896649 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.896897 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.896991 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.897265 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.897361 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.897598 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.897723 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.897939 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.898058 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.898289 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.898391 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.898638 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.898746 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.899006 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.899111 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.899346 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.899447 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.899688 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.899799 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.900034 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.900162 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.900383 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.900487 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.900721 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.900823 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.901063 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.901165 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.901408 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.901509 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.901752 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.901854 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.902616 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.902771 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.902999 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.903167 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.903333 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.903487 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.903652 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.903815 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.903977 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.904129 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.904291 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.904447 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.904598 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.904750 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.904950 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.905114 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.905285 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.905437 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.905671 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.905954 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.906107 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.906325 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.906479 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.906642 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.906792 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.907024 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.907218 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.907414 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.907563 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.907759 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.907908 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.908060 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.908211 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.908379 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.908530 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.908694 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.908845 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.908997 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.909148 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.909315 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.909467 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.909619 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.909790 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.909942 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.910137 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.910240 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.910336 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.910575 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.910676 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.910927 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.911047 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.911278 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.911386 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.911623 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.911724 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.911961 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.912070 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.912301 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.912402 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.912638 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.912745 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.912976 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.913085 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.913331 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.913432 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.913672 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.913772 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.914013 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.914126 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.914345 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.914447 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.914706 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.914807 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.915068 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.915408 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.915509 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.915745 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.915853 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.916085 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.916197 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.916451 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.916558 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.916782 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.916889 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.917157 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.917269 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.917531 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.917674 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.918440 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.918699 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.918809 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.919089 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.919193 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.919440 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.919542 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.919809 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.919918 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.920153 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.920253 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.920490 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.920590 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.920833 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.920941 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.921172 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.921279 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.921514 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.921614 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.921855 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.921967 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.922194 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.922296 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.922533 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.922640 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.922870 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.923016 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.923243 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.923344 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.923576 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.923676 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.923923 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.924032 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.924258 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.924366 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.924597 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.924698 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.924938 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.925043 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.925281 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.925389 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.925622 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.925723 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.925953 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.926061 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.926293 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.926394 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.926635 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.926743 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.927000 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.927105 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.927347 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.927475 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.927686 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.927788 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.928026 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.928127 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.928367 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.928467 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.928729 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.928842 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.929083 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.929190 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.929424 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.929531 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.929768 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.929880 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.930100 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.930201 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.930438 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.930549 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.930776 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.930889 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.931143 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.931255 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.931483 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.931586 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.931821 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.931939 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.932160 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.932260 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.932491 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.932591 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.932830 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.932942 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.933226 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.933339 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.933570 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.933678 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.933911 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.934021 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.934249 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.934356 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.934587 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.934687 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.934949 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.935053 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.935303 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.935405 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.935675 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.935784 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.936017 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.936119 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.936358 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.936460 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.936705 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.936807 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.937047 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.937154 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.937378 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.937478 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.937722 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.937833 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.938061 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.938164 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.938409 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.938509 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.938746 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.938855 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.939113 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.939214 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.939515 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.939650 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.939806 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.939922 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.940145 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.940253 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.940493 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.940594 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.940832 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.940943 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.941179 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.941280 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.941511 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.941619 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.941851 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.941960 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.942187 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.942289 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.942530 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.942632 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.942873 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.943047 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.943238 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.943349 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.943579 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.943679 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.943917 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.944020 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.944262 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.944363 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.944607 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.944729 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.944954 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.945056 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.945296 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.945413 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.945639 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.945740 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.945985 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.946085 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.946323 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.946431 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.946665 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.946766 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.947031 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.947137 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.947372 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.947473 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.947717 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.947882 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.948059 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.948159 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.948396 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.948503 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.948734 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.949352 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.949693 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.949804 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.950058 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.950160 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.950426 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.950538 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.950808 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.950922 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.951177 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.951277 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.951529 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.951641 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.951877 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.951977 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.952222 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.952329 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.952562 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.952665 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.952911 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.953012 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.953266 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.953367 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.953622 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.953723 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.953979 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.954080 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.954315 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.954416 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.954658 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.954765 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.955029 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.955146 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.955380 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.955490 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.955713 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.955816 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.956056 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.956157 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.956395 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.956495 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.956748 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.956857 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.957089 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.957190 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.957432 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.957543 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.957786 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.957886 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.958134 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.958244 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.958489 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.958601 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.958837 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.958961 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.959313 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.959414 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.959659 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.959771 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.960012 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.960114 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.960367 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.960468 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.960715 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.960824 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.961048 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.961156 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.961398 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.961500 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.961743 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.961852 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.962087 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.962188 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.962444 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.962543 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.962809 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.962946 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.963183 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.963284 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.963539 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.963639 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.963879 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.963981 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.964224 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.964332 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.965116 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.965339 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.965496 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.965712 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.965816 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.966079 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.966178 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.966483 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.966596 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.966855 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.966977 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.967233 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.967334 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.967592 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.967701 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.967955 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.968056 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.968326 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.968437 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.968669 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.968798 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.969010 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.969164 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.969355 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.969519 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.969699 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.969875 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.970040 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.970252 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.970403 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.970622 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.970731 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.971039 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.971154 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.971391 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.971500 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.971728 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.971829 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.972067 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.972167 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.972406 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.972506 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.972766 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.972868 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.973105 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.973206 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.973461 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.973562 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.973805 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.973907 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.974144 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.974245 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.974504 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.974605 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.974846 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.974999 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.975228 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.975328 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.975565 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.975684 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.975906 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.976049 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.976243 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.976421 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.976581 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.976777 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.976964 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.977146 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.977301 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.977515 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.977655 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.977891 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.978022 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.978241 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.978342 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.978589 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.978690 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.978950 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.979063 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.979292 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.979404 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.979640 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.979749 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.980040 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.980157 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.980392 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.980640 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.980756 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.980978 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.981087 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.981321 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.981428 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.981667 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.981767 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.982011 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.982115 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.982354 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.982456 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.982693 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.983075 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.983333 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.983436 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.983675 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.983784 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.984013 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.984114 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.984352 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.984454 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.984703 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.984810 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.985036 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.985149 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.985402 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.985534 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.985742 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.985842 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.986081 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.986196 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.986415 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.986524 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.986755 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.986862 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.987150 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.987253 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.987483 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.987608 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.987860 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.987962 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.988214 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.988325 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.988561 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.988672 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.988920 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.989034 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.989268 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.989388 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.989630 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.989734 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.989979 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.990087 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.990331 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.990440 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.990673 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.990785 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.991046 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.991153 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.991399 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.991512 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.991744 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.991847 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.992086 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.992195 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.992422 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.992531 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.992765 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.992875 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.993108 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.993209 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.993447 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.993557 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.993794 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.994020 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.994165 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.994388 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.994497 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.994761 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.994863 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.995136 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.995249 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.995483 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.995597 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.995950 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.996061 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.996301 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.996409 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.996699 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.996813 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.997102 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.997224 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.997389 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.997492 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.997737 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.997846 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.998083 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.998184 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.998449 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.998560 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.998797 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.998965 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.999192 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.999318 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.999554 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.999667 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:45.999900 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.000003 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.000251 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.000352 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.000599 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.000700 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.000955 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.001058 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.001317 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.001419 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.001679 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.001789 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.002016 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.002118 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.002371 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.002472 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.002718 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.002828 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.003099 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.003204 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.003452 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.003690 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.003791 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.004064 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.004167 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.004444 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.004546 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.004786 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.004900 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.005131 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.005233 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.005478 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.005585 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.005828 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.005974 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.006174 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.006280 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.006528 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.006632 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.006880 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.007017 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.007251 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.007354 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.007590 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.007691 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.007938 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.008041 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.008312 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.008521 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.008682 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.008870 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.009032 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.009238 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.009393 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.009573 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.009723 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.009937 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.010103 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.010255 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.010408 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.010608 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.010770 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.010997 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.011104 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.011876 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.012056 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.012232 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.012429 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.012540 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.012797 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.012898 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.013170 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.013299 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.013516 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.013627 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.013860 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.013961 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.014198 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.014299 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.014554 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.014664 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.014888 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.015036 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.015266 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.015516 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.015630 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.015911 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.016012 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.016264 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.016365 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.016634 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.016743 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.017001 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.017102 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.017350 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.017450 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.017695 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.017804 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.018044 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.018145 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.018380 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.018642 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.018747 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.019034 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.019140 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.019418 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.019519 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.019751 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.019863 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.020094 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.020196 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.020438 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.020539 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.020782 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.020893 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.021124 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.021230 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.021467 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.021568 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.021799 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.021908 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.022148 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.022249 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.022483 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.022590 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.022825 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.022976 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.023198 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.023301 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.023544 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.023655 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.023878 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.023980 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.024217 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.024318 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.024559 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.024661 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.024898 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.025168 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.025275 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.025559 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.025659 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.025903 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.026018 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.026242 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.026350 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.026589 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.026689 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.027535 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.027659 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.027896 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.028055 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.028233 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.028337 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.028593 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.028703 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.028926 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.029028 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.029266 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.029369 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.029617 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.029721 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.029957 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.030062 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.030298 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.030400 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.030644 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.030746 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.031013 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.031119 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.031371 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.031495 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.031725 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.031828 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.032074 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.032321 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.032440 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.032699 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.032964 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.033087 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.033186 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.033419 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.033531 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.033776 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.033906 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.034114 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.034220 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.034456 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.034558 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.034796 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.034960 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.035182 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.035299 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.035522 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.035641 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.035865 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.035975 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.036202 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.036320 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.036545 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.036648 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.036882 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.036992 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.037224 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.037329 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.037560 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.037670 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.037900 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.038002 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.038237 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.038348 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.038579 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.038736 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.038938 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.039044 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.039307 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.039410 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.039660 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.039774 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.040003 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.040113 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.040358 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.040460 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.040705 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.040874 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.041043 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.041146 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.041392 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.041494 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.041739 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.042025 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.042128 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.042411 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.042513 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.042809 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.043003 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.043251 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.043355 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.043675 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.043778 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.044029 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.044142 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.044377 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.044496 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.044722 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.044824 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.045063 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.045179 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.045419 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.045521 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.045774 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.045876 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.046127 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.046238 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.046482 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.046584 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.046816 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.046983 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.047200 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.047311 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.047541 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.047650 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.047887 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.047990 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.048272 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.048381 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.048588 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.048690 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.048957 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.049069 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.049320 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.049435 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.049676 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.049789 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.050019 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.050132 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.050367 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.050468 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.050713 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.050814 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.051085 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.051202 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.051435 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.051538 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.051786 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.051888 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.052142 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.052253 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.052491 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.052594 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.052837 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.052938 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.053177 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.053290 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.053526 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.053629 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.053881 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.053998 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.054221 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.054375 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.054571 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.054680 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.054942 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.055049 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.055288 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.055391 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.055659 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.055769 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.056008 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.056110 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.056369 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.056487 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.056716 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.056819 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.057073 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.057182 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.057411 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.057514 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.057757 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.057866 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.058112 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.058284 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.058570 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.058731 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.058962 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.059076 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.059301 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.059420 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.059649 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.059753 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.059998 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.060100 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.060347 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.060457 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.060687 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.060796 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.061031 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.061133 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.061378 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.061489 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.061741 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.061850 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.062100 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.062210 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.062434 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.062537 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.062792 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.062913 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.063171 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.063273 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.063521 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.063630 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.063867 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.064000 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.064210 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.064332 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.064571 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.064686 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.064909 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.065013 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.065258 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.065369 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.065597 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.065700 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.065944 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.066047 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.066315 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.066414 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.066646 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.066765 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.067059 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.067166 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.067408 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.067522 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.067765 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.067875 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.068128 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.068242 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.068485 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.068596 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.068833 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.068948 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.069206 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.069326 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.069558 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.069673 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.069824 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79612) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 21 03:54:46.069926 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.070246 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.070601 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.070988 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.071345 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.071720 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.072094 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.072454 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.072828 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.073191 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.073556 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.074429 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.074846 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.075341 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.075702 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.076066 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.076423 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.076778 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.077141 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.077503 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.077875 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.078247 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.078621 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.079016 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.079426 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.079783 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.080176 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.080556 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:54:46.080837 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79611) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 21 03:54:46.107261 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_db.sqlalchemy.engines [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79612) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 03:54:46.117100 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_db.sqlalchemy.engines [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79611) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 03:54:46.450951 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.context [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),13ce7efe-25d0-4763-8e8a-03d9c565bf27(cell1) {{(pid=79612) load_cells /opt/stack/nova/nova/context.py:467}} Dec 21 03:54:46.456291 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79612) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 03:54:46.458105 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79612) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 03:54:46.458690 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.context [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),13ce7efe-25d0-4763-8e8a-03d9c565bf27(cell1) {{(pid=79611) load_cells /opt/stack/nova/nova/context.py:467}} Dec 21 03:54:46.458996 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79612) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 03:54:46.462754 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=79612) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 03:54:46.464155 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 03:54:46.466069 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 03:54:46.466994 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 03:54:46.472139 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 03:54:46.487767 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_db.sqlalchemy.engines [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79612) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 03:54:46.490410 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_db.sqlalchemy.engines [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79612) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 03:54:46.500218 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_db.sqlalchemy.engines [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79611) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 03:54:46.501110 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_db.sqlalchemy.engines [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79611) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 03:54:46.522075 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_db.sqlalchemy.engines [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79612) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 03:54:46.532337 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_db.sqlalchemy.engines [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79611) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 03:54:46.698270 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Loading Gnome Dec 21 03:54:46.703508 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Loading Gnome Dec 21 03:54:46.719336 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Loading Google Dec 21 03:54:46.722564 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Loading Windows (alt) Dec 21 03:54:46.723499 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Loading Google Dec 21 03:54:46.726823 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Loading Windows (alt) Dec 21 03:54:46.727297 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Loading file Dec 21 03:54:46.728397 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Loading keyczar Dec 21 03:54:46.728847 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Loading multi Dec 21 03:54:46.729713 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Loading pyfs Dec 21 03:54:46.732055 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Loading file Dec 21 03:54:46.733397 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Loading keyczar Dec 21 03:54:46.733835 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Loading multi Dec 21 03:54:46.734688 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO keyring.backend [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Loading pyfs Dec 21 03:54:47.012284 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: WARNING keystonemiddleware.auth_token [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 21 03:54:47.015348 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: WARNING keystonemiddleware.auth_token [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 21 03:54:47.019420 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: WARNING keystonemiddleware.auth_token [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 21 03:54:47.022555 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: WARNING keystonemiddleware.auth_token [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 21 03:54:47.353833 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: WARNING keystonemiddleware.auth_token [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 21 03:54:47.360349 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: WARNING keystonemiddleware.auth_token [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 21 03:54:47.365860 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55814ed809c0 pid: 79611 (default app) Dec 21 03:54:47.366930 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: WARNING keystonemiddleware.auth_token [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 21 03:54:47.368108 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:54:47.369282 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-b30c1493-d069-4d23-a39a-422f4507b349 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001786 Dec 21 03:54:47.369758 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 779 bytes} [Mon Dec 21 03:54:47 2020] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:54:47.373016 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: WARNING keystonemiddleware.auth_token [None req-45cbb51e-99d9-4fef-9760-884fd2a8f2c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 21 03:54:47.378426 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55814ed809c0 pid: 79612 (default app) Dec 21 03:56:12.319886 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-df6e070a-a4a9-4887-b517-ed6b26eb0961 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:56:12.345297 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-df6e070a-a4a9-4887-b517-ed6b26eb0961 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.516155 Dec 21 03:56:12.345908 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1150 bytes} [Mon Dec 21 03:56:11 2020] GET /compute/v2.1/flavors/detail => generated 15 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:15.220470 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-a8fffd75-f48a-470b-9f94-2153bd2ee1bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:15.249880 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:15.249880 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: warnings.warn(msg) Dec 21 03:56:15.278100 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-a8fffd75-f48a-470b-9f94-2153bd2ee1bd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.410916 Dec 21 03:56:15.278717 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 1/3] 10.222.0.16 () {62 vars in 1183 bytes} [Mon Dec 21 03:56:14 2020] POST /compute/v2.1/flavors => generated 367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:56:15.295348 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-2bd9c887-4513-419d-8d30-f30e10530220 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:15.302413 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:15.302413 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: warnings.warn(msg) Dec 21 03:56:15.340043 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-2bd9c887-4513-419d-8d30-f30e10530220 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.054155 Dec 21 03:56:15.340634 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 3/4] 10.222.0.16 () {62 vars in 1236 bytes} [Mon Dec 21 03:56:15 2020] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:15.356248 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-bd3e6ec6-dcd8-440a-8a9a-998c00e1032b admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:56:15.378645 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-bd3e6ec6-dcd8-440a-8a9a-998c00e1032b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.031849 Dec 21 03:56:15.379262 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 2/5] 10.222.0.16 () {58 vars in 1183 bytes} [Mon Dec 21 03:56:15 2020] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:17.960104 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-1e22ab2e-dcbe-4871-8f2c-fbbd14a13582 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:17.987922 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:17.987922 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: warnings.warn(msg) Dec 21 03:56:18.011381 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-1e22ab2e-dcbe-4871-8f2c-fbbd14a13582 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.137256 Dec 21 03:56:18.011920 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 4/6] 10.222.0.16 () {62 vars in 1183 bytes} [Mon Dec 21 03:56:17 2020] POST /compute/v2.1/flavors => generated 364 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:56:18.027898 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-47faf6a8-8dd8-4814-a415-1c6cefd21560 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:18.034391 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:18.034391 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: warnings.warn(msg) Dec 21 03:56:18.070640 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-47faf6a8-8dd8-4814-a415-1c6cefd21560 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.051799 Dec 21 03:56:18.072032 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 3/7] 10.222.0.16 () {62 vars in 1236 bytes} [Mon Dec 21 03:56:18 2020] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:18.087328 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-2ccf40f2-4f26-4eef-bd57-03952c5c768f admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:56:18.108060 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-2ccf40f2-4f26-4eef-bd57-03952c5c768f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029840 Dec 21 03:56:18.108873 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1183 bytes} [Mon Dec 21 03:56:18 2020] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:20.680083 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-7c997952-229e-496f-8186-1674870febc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:20.707054 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-7c997952-229e-496f-8186-1674870febc1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.113006 Dec 21 03:56:20.707650 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 4/9] 10.222.0.16 () {62 vars in 1183 bytes} [Mon Dec 21 03:56:20 2020] POST /compute/v2.1/flavors => generated 364 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:56:20.724522 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-8dcc0afc-a1ff-4afd-a7f2-6da43fcc661f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:20.764939 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-8dcc0afc-a1ff-4afd-a7f2-6da43fcc661f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.049695 Dec 21 03:56:20.765541 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 6/10] 10.222.0.16 () {62 vars in 1236 bytes} [Mon Dec 21 03:56:20 2020] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:20.781188 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-6f52f132-d276-4473-b3b4-03813d3d9609 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:56:20.801500 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-6f52f132-d276-4473-b3b4-03813d3d9609 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029929 Dec 21 03:56:20.802080 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1183 bytes} [Mon Dec 21 03:56:20 2020] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:23.385641 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-417f8415-4f3b-4306-8854-d3aef537150d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:23.412183 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-417f8415-4f3b-4306-8854-d3aef537150d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.113658 Dec 21 03:56:23.412774 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 7/12] 10.222.0.16 () {62 vars in 1183 bytes} [Mon Dec 21 03:56:23 2020] POST /compute/v2.1/flavors => generated 364 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:56:23.429237 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-2977486e-700a-4b4f-9dd1-adcb2e5723d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:23.473291 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-2977486e-700a-4b4f-9dd1-adcb2e5723d1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.052934 Dec 21 03:56:23.473932 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 6/13] 10.222.0.16 () {62 vars in 1236 bytes} [Mon Dec 21 03:56:23 2020] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:23.489402 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-0a344552-360e-4543-8888-d9916ce8be27 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:56:23.510499 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-0a344552-360e-4543-8888-d9916ce8be27 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030266 Dec 21 03:56:23.511111 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 8/14] 10.222.0.16 () {58 vars in 1183 bytes} [Mon Dec 21 03:56:23 2020] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:26.095848 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-4bf696df-a290-408f-9250-dc0956b393db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:26.123643 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-4bf696df-a290-408f-9250-dc0956b393db admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.113155 Dec 21 03:56:26.124220 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 7/15] 10.222.0.16 () {62 vars in 1183 bytes} [Mon Dec 21 03:56:26 2020] POST /compute/v2.1/flavors => generated 364 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:56:26.140136 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-03d147be-c3d0-48b3-a92e-5932bd933311 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:26.182591 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-03d147be-c3d0-48b3-a92e-5932bd933311 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.051494 Dec 21 03:56:26.183216 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 9/16] 10.222.0.16 () {62 vars in 1236 bytes} [Mon Dec 21 03:56:26 2020] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:26.198332 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-f14276d4-85df-452f-8502-f107e9fa5379 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:56:26.221108 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-f14276d4-85df-452f-8502-f107e9fa5379 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.031725 Dec 21 03:56:26.221680 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1183 bytes} [Mon Dec 21 03:56:26 2020] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:28.797847 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-53bed884-0c7f-41ae-9ece-79368e154059 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:56:28.817284 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-53bed884-0c7f-41ae-9ece-79368e154059 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.104359 Dec 21 03:56:28.817854 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 10/18] 10.222.0.16 () {58 vars in 1150 bytes} [Mon Dec 21 03:56:28 2020] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 03:56:31.398081 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-39eafbaa-3599-40eb-952b-bab42c9c4af2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:31.424559 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-39eafbaa-3599-40eb-952b-bab42c9c4af2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.113020 Dec 21 03:56:31.425151 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 9/19] 10.222.0.16 () {62 vars in 1183 bytes} [Mon Dec 21 03:56:31 2020] POST /compute/v2.1/flavors => generated 362 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:56:31.442080 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-5f2c76fb-96f8-4316-8fca-ae636aed8857 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:31.483919 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-5f2c76fb-96f8-4316-8fca-ae636aed8857 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050756 Dec 21 03:56:31.484542 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 11/20] 10.222.0.16 () {62 vars in 1233 bytes} [Mon Dec 21 03:56:31 2020] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:31.500837 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-f3382aa6-aaf4-4239-a0d8-4a4605fe88d2 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:56:31.521744 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-f3382aa6-aaf4-4239-a0d8-4a4605fe88d2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030924 Dec 21 03:56:31.522281 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 10/21] 10.222.0.16 () {58 vars in 1180 bytes} [Mon Dec 21 03:56:31 2020] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:34.124699 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-39602b39-b7a3-4572-8291-79c89180b1f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:34.151565 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-39602b39-b7a3-4572-8291-79c89180b1f4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.113724 Dec 21 03:56:34.152160 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 12/22] 10.222.0.16 () {62 vars in 1183 bytes} [Mon Dec 21 03:56:34 2020] POST /compute/v2.1/flavors => generated 365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:56:34.168645 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-6235f0d3-83d2-4c05-bea3-89757d2d8ff0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:34.208642 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-6235f0d3-83d2-4c05-bea3-89757d2d8ff0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.049487 Dec 21 03:56:34.209238 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 11/23] 10.222.0.16 () {62 vars in 1233 bytes} [Mon Dec 21 03:56:34 2020] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:34.224245 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-b7b01a7f-0d69-4712-be54-c65d80ff9d00 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:56:34.246181 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-b7b01a7f-0d69-4712-be54-c65d80ff9d00 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030846 Dec 21 03:56:34.246742 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 13/24] 10.222.0.16 () {58 vars in 1180 bytes} [Mon Dec 21 03:56:34 2020] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:36.839610 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-5931c756-c83d-40e8-b2f4-b11822c0cbb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:36.867428 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-5931c756-c83d-40e8-b2f4-b11822c0cbb5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.114150 Dec 21 03:56:36.868110 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 12/25] 10.222.0.16 () {62 vars in 1183 bytes} [Mon Dec 21 03:56:36 2020] POST /compute/v2.1/flavors => generated 366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:56:36.884176 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-d895f77f-30c3-4744-986a-4d326de143ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:36.924620 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-d895f77f-30c3-4744-986a-4d326de143ca admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.049648 Dec 21 03:56:36.925209 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 14/26] 10.222.0.16 () {62 vars in 1233 bytes} [Mon Dec 21 03:56:36 2020] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:36.940298 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-398dc4d5-76c1-4124-bcb5-6dacebff919e admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:56:36.962679 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-398dc4d5-76c1-4124-bcb5-6dacebff919e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030925 Dec 21 03:56:36.963309 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1180 bytes} [Mon Dec 21 03:56:36 2020] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:39.557502 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-b286e659-c0ab-43bd-91e6-0d1a19fe3879 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:39.584473 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-b286e659-c0ab-43bd-91e6-0d1a19fe3879 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.114886 Dec 21 03:56:39.585069 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 15/28] 10.222.0.16 () {62 vars in 1183 bytes} [Mon Dec 21 03:56:39 2020] POST /compute/v2.1/flavors => generated 365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:56:39.601677 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-18144494-73d6-49b6-953c-892037c0b32a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:39.642375 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-18144494-73d6-49b6-953c-892037c0b32a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.049826 Dec 21 03:56:39.642989 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 14/29] 10.222.0.16 () {62 vars in 1233 bytes} [Mon Dec 21 03:56:39 2020] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:39.658303 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-e9b9db94-e58a-42f4-851b-e6360a66565c admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:56:39.679147 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-e9b9db94-e58a-42f4-851b-e6360a66565c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029588 Dec 21 03:56:39.679706 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 16/30] 10.222.0.16 () {58 vars in 1180 bytes} [Mon Dec 21 03:56:39 2020] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:42.253046 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-6122addc-d3b0-46da-85c0-ad9de0f32422 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:42.279843 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-6122addc-d3b0-46da-85c0-ad9de0f32422 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.113086 Dec 21 03:56:42.280455 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 15/31] 10.222.0.16 () {62 vars in 1183 bytes} [Mon Dec 21 03:56:42 2020] POST /compute/v2.1/flavors => generated 368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:56:42.297225 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-b8702a77-574e-4db0-b3ea-47dc51e21524 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:56:42.338195 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-b8702a77-574e-4db0-b3ea-47dc51e21524 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050834 Dec 21 03:56:42.338804 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 17/32] 10.222.0.16 () {62 vars in 1233 bytes} [Mon Dec 21 03:56:42 2020] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:56:42.354701 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-56b698af-8f14-4694-8c56-4b9554dff6cd admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:56:42.375967 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-56b698af-8f14-4694-8c56-4b9554dff6cd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030927 Dec 21 03:56:42.376528 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 16/33] 10.222.0.16 () {58 vars in 1180 bytes} [Mon Dec 21 03:56:42 2020] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 03:57:54.859773 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-e3d4b8d8-71ce-45f7-a269-09341567d365 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:57:54.883640 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-e3d4b8d8-71ce-45f7-a269-09341567d365 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.109187 Dec 21 03:57:54.884221 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 18/34] 10.222.0.16 () {58 vars in 1150 bytes} [Mon Dec 21 03:57:54 2020] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 03:57:56.508283 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-56b698af-8f14-4694-8c56-4b9554dff6cd admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:57:56.509406 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-56b698af-8f14-4694-8c56-4b9554dff6cd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Dec 21 03:57:56.509842 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 17/35] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 03:57:56 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:57:56.722208 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-6d3ba3f5-2d68-4527-b999-11fbed81a15b admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:57:56.737184 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.wsgi [None req-6d3ba3f5-2d68-4527-b999-11fbed81a15b admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 21 03:57:56.737808 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-6d3ba3f5-2d68-4527-b999-11fbed81a15b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=79611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 03:57:56.738653 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-6d3ba3f5-2d68-4527-b999-11fbed81a15b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.102906 Dec 21 03:57:56.739252 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 19/36] 10.222.0.16 () {60 vars in 1181 bytes} [Mon Dec 21 03:57:56 2020] GET /compute/v2.1/flavors/42 => generated 75 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 21 03:57:56.754339 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-8afd1080-9e10-4591-88a1-06fd8af486e7 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:57:56.776349 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-8afd1080-9e10-4591-88a1-06fd8af486e7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.030860 Dec 21 03:57:56.776913 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1201 bytes} [Mon Dec 21 03:57:56 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 03:57:56.792526 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-697d5f95-ba86-4a11-9018-65f67e869019 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:57:56.814690 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-697d5f95-ba86-4a11-9018-65f67e869019 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.030910 Dec 21 03:57:56.815322 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 20/38] 10.222.0.16 () {60 vars in 1201 bytes} [Mon Dec 21 03:57:56 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 03:57:56.831003 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-55c710a1-66ec-4658-ba4d-f09f95b901b2 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:57:56.844884 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.wsgi [None req-55c710a1-66ec-4658-ba4d-f09f95b901b2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 21 03:57:56.845509 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-55c710a1-66ec-4658-ba4d-f09f95b901b2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=79612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 03:57:56.846351 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-55c710a1-66ec-4658-ba4d-f09f95b901b2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.024858 Dec 21 03:57:56.846889 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1181 bytes} [Mon Dec 21 03:57:56 2020] GET /compute/v2.1/flavors/42 => generated 75 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 21 03:57:58.387808 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-697d5f95-ba86-4a11-9018-65f67e869019 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:57:58.389073 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-697d5f95-ba86-4a11-9018-65f67e869019 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Dec 21 03:57:58.389503 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 21/40] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 03:57:58 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:57:58.602189 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-848de68c-e62b-4ba3-b243-49b4c473761b admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:57:58.615192 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.wsgi [None req-848de68c-e62b-4ba3-b243-49b4c473761b admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 21 03:57:58.615801 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-848de68c-e62b-4ba3-b243-49b4c473761b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=79612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 03:57:58.616637 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-848de68c-e62b-4ba3-b243-49b4c473761b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.099818 Dec 21 03:57:58.617178 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1181 bytes} [Mon Dec 21 03:57:58 2020] GET /compute/v2.1/flavors/84 => generated 75 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 21 03:57:58.632396 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-01c5b336-6c3d-4b2a-8292-6323a1b9acbd admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:57:58.657212 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-01c5b336-6c3d-4b2a-8292-6323a1b9acbd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.033908 Dec 21 03:57:58.657768 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1201 bytes} [Mon Dec 21 03:57:58 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 03:57:58.672956 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-77998ec9-ccfd-47f4-9032-747c231634c3 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:57:58.696998 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-77998ec9-ccfd-47f4-9032-747c231634c3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.032858 Dec 21 03:57:58.697562 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 21/43] 10.222.0.16 () {60 vars in 1201 bytes} [Mon Dec 21 03:57:58 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 03:57:58.713188 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-6d427858-2be0-46f4-9a8d-77a5dd3c9778 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:57:58.726651 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.wsgi [None req-6d427858-2be0-46f4-9a8d-77a5dd3c9778 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 21 03:57:58.727302 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-6d427858-2be0-46f4-9a8d-77a5dd3c9778 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=79611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 03:57:58.728141 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-6d427858-2be0-46f4-9a8d-77a5dd3c9778 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.023820 Dec 21 03:57:58.728670 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1181 bytes} [Mon Dec 21 03:57:58 2020] GET /compute/v2.1/flavors/84 => generated 75 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 21 03:58:00.294403 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-77998ec9-ccfd-47f4-9032-747c231634c3 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:00.295623 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-77998ec9-ccfd-47f4-9032-747c231634c3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Dec 21 03:58:00.296053 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 03:58:00 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:58:00.512172 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-898f0caa-b14f-437e-aeab-5a90f51e2f58 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:00.525946 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.wsgi [None req-898f0caa-b14f-437e-aeab-5a90f51e2f58 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 21 03:58:00.526556 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-898f0caa-b14f-437e-aeab-5a90f51e2f58 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=79611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 03:58:00.527421 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-898f0caa-b14f-437e-aeab-5a90f51e2f58 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.104124 Dec 21 03:58:00.527941 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Dec 21 03:58:00 2020] GET /compute/v2.1/flavors/451 => generated 76 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 21 03:58:00.543209 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-bb8fda9a-bd58-4083-b404-e149806af4a3 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:00.565493 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-bb8fda9a-bd58-4083-b404-e149806af4a3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.031119 Dec 21 03:58:00.566049 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1201 bytes} [Mon Dec 21 03:58:00 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 03:58:00.582199 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:00.604426 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.031926 Dec 21 03:58:00.604986 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 25/48] 10.222.0.16 () {60 vars in 1201 bytes} [Mon Dec 21 03:58:00 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 03:58:00.620366 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-85919f4e-c644-49dd-ad13-3d4f3560f02e admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:00.633660 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.wsgi [None req-85919f4e-c644-49dd-ad13-3d4f3560f02e admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 21 03:58:00.634268 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-85919f4e-c644-49dd-ad13-3d4f3560f02e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=79612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 03:58:00.635155 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-85919f4e-c644-49dd-ad13-3d4f3560f02e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.023499 Dec 21 03:58:00.635689 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Dec 21 03:58:00 2020] GET /compute/v2.1/flavors/451 => generated 76 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 21 03:58:02.194395 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:02.195518 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Dec 21 03:58:02.195950 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 26/50] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 03:58:02 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:58:02.410170 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-15fe0797-2356-4adc-88da-7d01795b4a20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:58:02.444502 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-15fe0797-2356-4adc-88da-7d01795b4a20 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.120357 Dec 21 03:58:02.445255 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 25/51] 10.222.0.16 () {64 vars in 1226 bytes} [Mon Dec 21 03:58:02 2020] POST /compute/v2.1/flavors => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 03:58:03.983960 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:03.985355 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001842 Dec 21 03:58:03.985781 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 27/52] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 03:58:03 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:58:04.200562 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-f75f748d-7ada-48ba-be63-1b5350bbef93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:58:04.234774 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-f75f748d-7ada-48ba-be63-1b5350bbef93 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.120786 Dec 21 03:58:04.235385 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 26/53] 10.222.0.16 () {64 vars in 1226 bytes} [Mon Dec 21 03:58:04 2020] POST /compute/v2.1/flavors => generated 405 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 03:58:05.774868 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:05.775974 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Dec 21 03:58:05.776393 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 28/54] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 03:58:05 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:58:05.990246 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-4ff39b78-1d54-4232-a0fc-ec23b5627248 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:58:06.024877 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-4ff39b78-1d54-4232-a0fc-ec23b5627248 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.120802 Dec 21 03:58:06.025409 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 27/55] 10.222.0.16 () {64 vars in 1226 bytes} [Mon Dec 21 03:58:05 2020] POST /compute/v2.1/flavors => generated 407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 03:58:07.577557 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:07.578611 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Dec 21 03:58:07.579061 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 29/56] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 03:58:07 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:58:07.791360 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-3485e523-b138-4cb4-be78-1856d59bb97b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 03:58:07.825644 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-3485e523-b138-4cb4-be78-1856d59bb97b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.119234 Dec 21 03:58:07.826264 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 28/57] 10.222.0.16 () {64 vars in 1226 bytes} [Mon Dec 21 03:58:07 2020] POST /compute/v2.1/flavors => generated 409 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 03:58:09.363759 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:09.364816 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Dec 21 03:58:09.365240 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 30/58] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 03:58:09 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:58:09.583288 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-e6507ab7-e058-4214-8d62-8cfb3d835cbd admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:09.619194 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-e6507ab7-e058-4214-8d62-8cfb3d835cbd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.124192 Dec 21 03:58:09.619778 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 29/59] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Dec 21 03:58:09 2020] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 03:58:59.650796 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:59.652048 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-50634368-fc4e-4d82-a515-b78825f49ea7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Dec 21 03:58:59.652345 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 31/60] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 03:58:59 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 03:58:59.868265 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-feaa608b-cfdc-4c39-a4de-9eef18ea96f3 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 03:58:59.901841 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-feaa608b-cfdc-4c39-a4de-9eef18ea96f3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.122513 Dec 21 03:58:59.902413 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 30/61] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Dec 21 03:58:59 2020] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:00:15.876414 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-09384bdf-93ee-49d3-867a-fc21362f8440 tempest-verify_tempest_config-154117875 tempest-verify_tempest_config-154117875] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:00:15.883334 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-09384bdf-93ee-49d3-867a-fc21362f8440 tempest-verify_tempest_config-154117875 tempest-verify_tempest_config-154117875] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.162118 Dec 21 04:00:15.883900 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 32/62] 10.222.0.16 () {58 vars in 1124 bytes} [Mon Dec 21 04:00:15 2020] GET /compute/v2.1/extensions => generated 22700 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:01:41.316664 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-feaa608b-cfdc-4c39-a4de-9eef18ea96f3 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:01:41.317731 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-feaa608b-cfdc-4c39-a4de-9eef18ea96f3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Dec 21 04:01:41.318157 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 31/63] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 04:01:41 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:01:41.609556 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-ab1b2066-0c0f-4032-b1c9-ca0c63968054 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:01:41.616003 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:41.616003 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: warnings.warn(msg) Dec 21 04:01:41.617572 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-ab1b2066-0c0f-4032-b1c9-ca0c63968054 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:01:41.618060 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-ab1b2066-0c0f-4032-b1c9-ca0c63968054 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:01:41.618906 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-ab1b2066-0c0f-4032-b1c9-ca0c63968054 admin admin] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:01:41.619578 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-ab1b2066-0c0f-4032-b1c9-ca0c63968054 admin admin] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:01:41.652148 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-ab1b2066-0c0f-4032-b1c9-ca0c63968054 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.87 time: 0.204161 Dec 21 04:01:41.652727 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Dec 21 04:01:41 2020] GET /compute/v2.1/os-services => generated 794 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:01:43.208560 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-feaa608b-cfdc-4c39-a4de-9eef18ea96f3 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:01:43.209641 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-feaa608b-cfdc-4c39-a4de-9eef18ea96f3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Dec 21 04:01:43.210070 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 32/65] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 04:01:43 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:01:43.426595 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-3f387da0-7aec-4a1a-8243-243bd155f270 admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:01:43.432824 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:43.432824 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: warnings.warn(msg) Dec 21 04:01:43.434393 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-3f387da0-7aec-4a1a-8243-243bd155f270 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:01:43.434872 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-3f387da0-7aec-4a1a-8243-243bd155f270 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:01:43.435741 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-3f387da0-7aec-4a1a-8243-243bd155f270 admin admin] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:01:43.436208 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-3f387da0-7aec-4a1a-8243-243bd155f270 admin admin] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:01:43.471262 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-3f387da0-7aec-4a1a-8243-243bd155f270 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.87 time: 0.131355 Dec 21 04:01:43.472055 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Dec 21 04:01:43 2020] GET /compute/v2.1/os-services => generated 1014 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:01:55.451398 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-feaa608b-cfdc-4c39-a4de-9eef18ea96f3 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:01:55.452517 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-feaa608b-cfdc-4c39-a4de-9eef18ea96f3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Dec 21 04:01:55.452932 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 33/67] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 04:01:55 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:01:55.668065 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-4d5942e7-1a14-4c27-870b-0c1a164b6d4c admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:01:55.674272 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:55.674272 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: warnings.warn(msg) Dec 21 04:01:55.675872 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-4d5942e7-1a14-4c27-870b-0c1a164b6d4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:01:55.676361 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-4d5942e7-1a14-4c27-870b-0c1a164b6d4c admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:01:55.677210 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-4d5942e7-1a14-4c27-870b-0c1a164b6d4c admin admin] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:01:55.677682 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-4d5942e7-1a14-4c27-870b-0c1a164b6d4c admin admin] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:01:55.706031 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-4d5942e7-1a14-4c27-870b-0c1a164b6d4c admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.87 time: 0.125842 Dec 21 04:01:55.706610 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Dec 21 04:01:55 2020] GET /compute/v2.1/os-services => generated 1038 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:01:57.253046 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-feaa608b-cfdc-4c39-a4de-9eef18ea96f3 admin admin] Calling method '>' {{(pid=79612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:01:57.254129 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-feaa608b-cfdc-4c39-a4de-9eef18ea96f3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Dec 21 04:01:57.254607 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79612|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1065 bytes} [Mon Dec 21 04:01:57 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:01:57.468999 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG nova.api.openstack.wsgi [None req-c45d7991-14ca-41e3-815a-bda6c5ca3bea admin admin] Calling method '>' {{(pid=79611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:01:57.475272 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:57.475272 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: warnings.warn(msg) Dec 21 04:01:57.476856 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-c45d7991-14ca-41e3-815a-bda6c5ca3bea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:01:57.477347 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-c45d7991-14ca-41e3-815a-bda6c5ca3bea admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:01:57.478202 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-c45d7991-14ca-41e3-815a-bda6c5ca3bea admin admin] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:01:57.478681 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: DEBUG oslo_concurrency.lockutils [None req-c45d7991-14ca-41e3-815a-bda6c5ca3bea admin admin] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79611) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:01:57.506104 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: INFO nova.api.openstack.requestlog [None req-c45d7991-14ca-41e3-815a-bda6c5ca3bea admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.87 time: 0.124470 Dec 21 04:01:57.506753 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: [pid: 79611|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Dec 21 04:01:57 2020] GET /compute/v2.1/os-services => generated 1038 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:02:55.392870 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: Mon Dec 21 04:02:55 2020 - graceful shutdown triggered... Dec 21 04:02:55.393367 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: Gracefully killing worker 1 (pid: 79611)... Dec 21 04:02:55.393463 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: Gracefully killing worker 2 (pid: 79612)... Dec 21 04:02:55.395842 dv-cinder-733062-17-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 21 04:02:56.393994 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: worker 1 buried after 1 seconds Dec 21 04:02:56.393994 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: worker 2 buried after 1 seconds Dec 21 04:02:56.393994 dv-cinder-733062-17-iscsi devstack@n-api.service[79610]: goodbye to uWSGI. Dec 21 04:02:56.395729 dv-cinder-733062-17-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 21 04:02:56.397435 dv-cinder-733062-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 21 04:02:56.405593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 21 04:02:56.407602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: *** Starting uWSGI 2.0.15-debian (64bit) on [Mon Dec 21 04:02:56 2020] *** Dec 21 04:02:56.407602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Dec 21 04:02:56.407602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Dec 21 04:02:56.407602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: nodename: dv-cinder-733062-17-iscsi Dec 21 04:02:56.407602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: machine: x86_64 Dec 21 04:02:56.407602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: clock source: unix Dec 21 04:02:56.407602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: pcre jit disabled Dec 21 04:02:56.407602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: detected number of CPU cores: 4 Dec 21 04:02:56.407602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: current working directory: / Dec 21 04:02:56.407602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: detected binary path: /usr/bin/uwsgi-core Dec 21 04:02:56.407602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: dropping root privileges as early as possible Dec 21 04:02:56.408407 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: your processes number limit is 47843 Dec 21 04:02:56.408407 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: your memory page size is 4096 bytes Dec 21 04:02:56.408407 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: detected max file descriptor number: 2048 Dec 21 04:02:56.408407 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: lock engine: pthread robust mutexes Dec 21 04:02:56.408407 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: thunder lock: enabled Dec 21 04:02:56.408407 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 21 04:02:56.408407 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: dropping root privileges after socket binding Dec 21 04:02:56.408407 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Dec 21 04:02:56.455310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Python main interpreter initialized at 0x56075e6b39c0 Dec 21 04:02:56.455310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: dropping root privileges after plugin initialization Dec 21 04:02:56.455310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: python threads support enabled Dec 21 04:02:56.455310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: your server socket listen backlog is limited to 100 connections Dec 21 04:02:56.455310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: your mercy for graceful operations on workers is 90 seconds Dec 21 04:02:56.455819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: mapped 402621 bytes (393 KB) for 2 cores Dec 21 04:02:56.455819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: *** Operational MODE: preforking *** Dec 21 04:02:56.457513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: dropping root privileges after application loading Dec 21 04:02:56.457513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: *** uWSGI is running in multiple interpreter mode *** Dec 21 04:02:56.457513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: spawned uWSGI master process (pid: 94296) Dec 21 04:02:56.457513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: spawned uWSGI worker 1 (pid: 94298, cores: 1) Dec 21 04:02:56.457513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: spawned uWSGI worker 2 (pid: 94299, cores: 1) Dec 21 04:02:56.457513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 21 04:02:56.456198 dv-cinder-733062-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 21 04:03:01.040900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 21 04:03:01.041515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 21 04:03:01.043209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 21 04:03:01.043660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 21 04:03:01.043959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 21 04:03:01.044433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.044817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.045189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.045559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.045945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.046311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.046681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.047078 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.047461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.047786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.048156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.048514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-17-iscsi {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.048891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.049249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.049608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.049984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.050337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.050716 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.051095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.051732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.052090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.052444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.052802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.053196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.053559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.053915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.054290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.054650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.055078 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.055436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.055811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-17-iscsi {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.056180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.056539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.056900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.057427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.057843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.058308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.058684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.059096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.059457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.059838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.060208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.060581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.060953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.061300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.061654 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.062013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.062381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.062731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.063109 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.063405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.063760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.064138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.064511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.064899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.065195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.065488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.065863 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.066247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.066614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.066993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.067354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.067711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.068065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.068420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.068774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.069128 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.069505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.069877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.070295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.070648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.071047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.071530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.071822 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.072178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.072578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.073497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.074030 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.074406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.074785 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.075191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.075606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.075911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.076286 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.076664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.077016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.077395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.077642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.077994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.078432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.078786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.079055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.079411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.079760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.080112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.080464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.080818 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.081214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.081499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.081848 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.082260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.082532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.082885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.083296 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.083669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.084024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.084379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.084731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.085085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.085463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.085820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.086172 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.086549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.086883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.087261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.087633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.087989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.088341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.089351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.089593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.090136 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.090521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.090853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.091238 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.091560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.091973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.092256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.092608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.092963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.093314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.093678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.094021 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.094378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.094733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.095101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.095462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.095866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.096348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.096610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.097030 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.097380 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.097769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.098156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.098525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.098890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.099278 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.099661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.100022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.100383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.100744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.101113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.101480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.101865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.102234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.102599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.102993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.103353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.103721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.104652 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.105020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.105384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.105784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.106185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.106547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.106945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.107312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.107694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.108065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.108428 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.108788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.109157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.109518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.109913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.110280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.110643 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.111046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.111662 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.112018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.112376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.112733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.113107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.113493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.113849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.114245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.114599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.114987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.115358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.115709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.116071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.116432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.116787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.117166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.117526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.117881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.118255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.118610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.118989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.119356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.119742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.120691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.121054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.121440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.121797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.122157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.122550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.122988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.123345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.123819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.124199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.124569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.124922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.125305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.125650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.126004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.126356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.126713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.127094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.127446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.127795 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.128150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.128500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.128879 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.129238 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.129589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.129941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.130293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.130699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.131102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.131499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.131862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.132234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.132601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.132959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.133312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.133666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.134025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.134401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.134753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.135138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.135529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.135889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.136257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.136640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.136996 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.137355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.137736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.138089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.138446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.138803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.138968 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 21 04:03:01.139200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.139316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 21 04:03:01.139556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.139910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.140268 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.140631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.140791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 21 04:03:01.140989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.141249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 21 04:03:01.141365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.141555 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 21 04:03:01.141741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.142002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.142124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.142360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.142476 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.142713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.142821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.143088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.143209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.143446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.143561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.143819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.143935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.144169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.144276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.144541 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.144646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.144911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.145017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.145213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.145331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.145599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.145713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.145963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.146085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-17-iscsi {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.146319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.146427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.146672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.146785 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.147040 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.147151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.147394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.147508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.147751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.147869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.148123 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.148238 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.148475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.148591 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.148840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.149109 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.149228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.149480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.149588 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.149842 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.149949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.150207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.150314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.150562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.150677 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.151008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.151178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.151383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.151575 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.151765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.152057 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.152166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.152426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.152544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.152789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.152902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.153146 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.153239 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.153522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-17-iscsi {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.153642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.153871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.153984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.154230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.154344 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.154587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.154707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.154955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.155119 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.155324 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.155490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.155694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.155824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.156213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.156415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.156595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.156800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.156960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.157163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.157351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.157530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.157733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.157900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.158116 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.158237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.158496 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.158603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.158855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.158992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.159248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.159367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.159616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.159731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.159989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.160103 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.160339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.160447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.160682 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.160796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.160974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.161093 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.161336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.161444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.161689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.161803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.162040 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.162162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.162397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.162550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.162703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.162817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.163026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.163152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.163409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.163525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.163752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.163859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.164113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.164227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.164465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.164578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.164820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.164933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.165168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.165275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.165524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.165631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.165873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.165992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.166221 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.166337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.167088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.167204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.167482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.167736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.167997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.168104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.168354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.168461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.168754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.168869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.169141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.169248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.169542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.169655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.169881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.169997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.170228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.170342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.170609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.170716 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.170981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.171105 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.171322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.171429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.171681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.171788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.172041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.172187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.172391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.172498 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.172747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.172854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.173108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.173258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.173464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.173580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.173817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.173934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.174171 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.174281 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.174470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.174576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.174824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.174985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.175202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.175320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.175559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.175675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.175913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.176031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.176264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.176382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.176619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.176738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.176959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.177065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.177310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.177418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.177666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.177780 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.178016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.178134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.178367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.178484 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.178710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.178824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.179085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.179206 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.179434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.179542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.179788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.179895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.180144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.180263 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.180495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.180601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.180855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.180967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.181208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.181383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.181551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.181663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.181901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.182043 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.182821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.183018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.183332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.183601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.183732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.183933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.184051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.184302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.184408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.184666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.184780 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.185029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.185145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.185379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.185486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.185738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.185851 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.186089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.186216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.186438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.186545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.186809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.186944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.187192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.187316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.187558 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.187665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.187937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.188046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.188291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.188410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.188644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.188754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.189003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.189110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.189347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.189464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.189692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.189798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.190041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.190155 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.190390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.190504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.190732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.190838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.191120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.191228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.191486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.191594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.191845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.191960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.192198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.192313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.192561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.192668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.192920 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.193062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.193288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.193395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 21 04:03:01.193642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.193762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.193998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.194113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.194408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.194539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.194714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.194826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.195100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.195208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.195463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.195586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.195819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.195925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.196180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.196298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.196538 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.196659 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.196897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.197016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.197256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.197363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.197601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.197709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.197988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.198276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.198391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.198741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.198857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.199151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.199266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.199549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.199656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.199907 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.200026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.200266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.200373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.200619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.200736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.200978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.201093 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.201328 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.201436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.201707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.202040 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.202159 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.202406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.202513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.202770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.202883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.203157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.203326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.203520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.203635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.203884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.203994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.204249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.204371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.204605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.204715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.204959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.205066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.205327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.205448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.205699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.205814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.206076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.206205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.206445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.206580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.206787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.206920 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.207168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.207276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.207528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.207636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.207892 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.207998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.208235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.208341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.208586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.208702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.208928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.209034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.209289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.209396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.209635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.209749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.210005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.210112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.210369 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.210481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.210769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.210884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.211158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.211276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.211529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.211643 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.211896 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.212010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.212258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.212365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.212629 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.212747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.212994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.213107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.213347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.213456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.213738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.213858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.214102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.214410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.214525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.214781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.214893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.215192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.215307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.215553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.215667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.215906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.216012 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.216269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.216384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.216616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.216733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.216973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.217087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.217340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.217449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.217703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.217861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.218063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.218178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.218431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.218545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.218828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.218967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.219236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.219352 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.219589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.219701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.219955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.220060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.220333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.220448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.220687 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.220792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.221038 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.221200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.221388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.221504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.221739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.221845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.222081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.222186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.222433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.222546 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.222782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.222892 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.223162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.223280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.223523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.223637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.223871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.223984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.224336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.224470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.224601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.224715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.224892 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.225002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.225243 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.225355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.225597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.225704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.225953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.226067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.226305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.226423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.226676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.226789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.227056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.227169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.227435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.227558 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.227793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.227952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.228139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.228253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.228490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.228612 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.228844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.228976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.229731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.229859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.230085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.230339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.230448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.230719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.230828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.231137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.231262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.231504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.231617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.231876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.231990 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.232238 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.232354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.232594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.232709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.232965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.233082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.233341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.233502 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.233696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.233805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.234047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.234179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.234403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.234522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.234756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.234870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.235135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.235256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.235486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.235602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.235845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.235958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.236189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.236295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.236792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.236900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.237133 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.237241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.237505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.237613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.237847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.237962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.238213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.238320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.238562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.238678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.238964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.239132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.239290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.239405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.239644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.239753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.240006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.240113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.240356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.240464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.240733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.240839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.241088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.241195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.241460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.241574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.241833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.241952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.242178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.242285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.242539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.242644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.242913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.243085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.243285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.243472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.243649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.243782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.244008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.244124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.245081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.245255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.245415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.245579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.245735 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.245898 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.246053 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.246214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.246381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.246547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.246713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.246874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.247088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.247255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.247414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.247569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.247734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.247900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.248054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.248207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.248359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.248511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.248676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.248830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.249013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.249172 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.249335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.249494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.249661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.249822 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.249974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.250132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.250294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.250593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.250704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.250815 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.251056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.251165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.251427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.252078 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.252448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.252556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.252815 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.252922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.253185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.253305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.253557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.253663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.253928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.254273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.254451 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.254651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.254768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.255039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.255150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.255417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.255536 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.255784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.255898 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.256153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.256266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.256515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.256634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.256897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.257011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.257257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.257371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.257618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.257733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.257979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.258085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.258339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.258446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.258690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.258804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.259074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.259195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.259430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.259537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.259788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.259897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.260142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.260277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.261072 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.261189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.261559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.261734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.261975 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.262122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.262346 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.262462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.262715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.262821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.263229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.263396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.263596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.263713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.263967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.264118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.264333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.264439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.264720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.264840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.265088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.265195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.265449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.265556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.265801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.265921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.266153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.266268 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.266524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.266661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.266888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.267101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.267305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.267432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.267676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.267803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.268037 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.268170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.268395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.268529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.268750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.268877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.269113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.269246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.269470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.269603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.269833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.270086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.270220 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.270646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.270782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.270889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.271040 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.271338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.271480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.271599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.271767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.271940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.272135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.272268 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.272490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.272626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.272878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.273030 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.273204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.273339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.273577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.273696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.273941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.274095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.274295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.274418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.274639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.274753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.275046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.275181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.275411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.275533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.275773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.275885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.276684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.276922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.277034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.277394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.277505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.277773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.277880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.278131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.278248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.278490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.278596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.278836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.278964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.279227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.279348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.279582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.279696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.279937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.280043 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.280284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.280399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.280637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.280782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.280997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.281131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.281343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.281462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.281700 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.281814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.282044 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.282158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.282396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.282512 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.282742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.282848 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.283123 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.283232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.283468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.283576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.283844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.283958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.284190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.284308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.284544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.284651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.284892 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.285051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.285244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.285352 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.285621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.285728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.285973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.286087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.286324 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.286439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.286725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.286842 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.287128 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.287252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.287503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.287751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.287859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.288140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.288247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.288511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.288624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.288900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.289013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.289272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.289379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.289621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.289729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.289974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.290081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.290320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.290433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.290694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.290847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.291081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.291191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.291436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.291579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.291990 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.292097 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.292358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.292471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.292721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.292836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.293083 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.293199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.293445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.293560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.293804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.293924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.294164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.294305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.294523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.294655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.294894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.295034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.295283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.295401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.295641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.295755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.295998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.296113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.296358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.296467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.296712 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.296820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.297062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.297170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.297417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.297525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.297766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.297873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.298130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.298245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.298486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.298593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.298844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.298976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.299219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.299335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.299570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.299725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.299937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.300096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.300298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.300488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.301052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.301388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.301554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.301732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.301901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.302063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.302217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.302425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.302594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.302760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.302983 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.303156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.303364 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.303527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.303725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.303900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.304066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.304303 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.304473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.304691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.304869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.305026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.305175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.305362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.305592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.305752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.305981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.306190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.306373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.306481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.306757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.306871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.307136 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.307817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.308198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.308438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.308604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.308854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.309001 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.309158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.309326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.309413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.309699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.309786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.310091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.310207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.310468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.310584 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.310850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.311043 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.311306 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.311402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.311672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.312167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.312418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.312615 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.312740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.312856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.312856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.313052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.313181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.313338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.313506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.313616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.313782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.313965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.314128 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.314321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.314494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.314699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.314880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.315092 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.315288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.315440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.315659 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.315775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.316034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.316140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.316399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.316506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.316787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.316902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.317139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.317247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.317517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.317625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.317873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.317981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.318238 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.318352 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.318602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.318717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.318989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.319101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.319352 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.319468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.319713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.319821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.320098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.320213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.320479 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.320593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.320835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.320977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.321203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.321348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.321556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.321673 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.321916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.322030 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.322272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.322379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.322632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.322751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.323622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.323789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.323981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.324298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.324418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.324679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.324767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.325033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.325147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.325390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.325513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.325792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.325906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.326115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.326223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.326482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.326654 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.326847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.326987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.327245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.327353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.327625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.327741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.327983 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.328092 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.328361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.328469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.328730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.328850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.329008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94298) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 21 04:03:01.329121 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.329429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.329793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.330203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.330570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.330982 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.331377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.331772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.332143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.332539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.332927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.333302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.333683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.334071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.334435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.335602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.335602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.335602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.335952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.336161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.336527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.336885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.337244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.337602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.337985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.338347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.338963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.339414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.339779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.340142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.340506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.340913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.341280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.341678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.342054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.342442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.342824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.343222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.343606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.343981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.344362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.344727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.345103 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.345474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.345848 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.346224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.346589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.346986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.347359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.347733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.348390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.348786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.349181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.349554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.349926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.350297 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.350675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.351067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.351447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.351814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.352185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.352554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.352945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.353337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.353727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.354163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.354804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.355215 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.355592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.356068 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.356386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.356871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.357891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.358277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.358662 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.359081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.359461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.359841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.360340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.360723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.361099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.361727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.362100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.362471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.362868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.363300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.363685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.364058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.364481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.364859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.365421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.365798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.366965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.366965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.366965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.367312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.367694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.368069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.368429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.368794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.369163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.369531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.370571 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.370681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_db.sqlalchemy.engines [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94298) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 04:03:01.371081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.371513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.371882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.372266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.372638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.373291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.373711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.374086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.374479 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.374869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.375419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.375688 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.376031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.376391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.376756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.377134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.377503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.377867 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.378227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.378598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.378991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.379359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.379728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.380090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.380477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.380841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.381244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.381552 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.381922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.382286 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.382649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.383032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.383398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.383769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.384131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.384499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.384863 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.385360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.385662 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.386336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.386723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.387140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.387509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.387874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.388258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.388630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.389018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.389390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.389762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.390180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.390557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.391239 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.391645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.392027 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.392436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.392844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.393210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.393612 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.393977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.394362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.394724 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.395112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.395497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.395943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.396331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.396613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.396981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.397350 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.397719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.398089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.398495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.398874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.399273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.399649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.400029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.400399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.400767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.401768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.402267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.402650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.403075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.403452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.403817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.404324 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.404696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.405076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.405477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.405919 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.406182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.406570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.406962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.407349 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.407714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.408166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.408440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.408809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.409218 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.409621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.409998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.410384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.410777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.411181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.411553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.411931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.412301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.412670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.413052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.413432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.413812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.414179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.414566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.414959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.415317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.415681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.416080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.416395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.417540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.418010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.418394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.418782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.419182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.419572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.419942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.420331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.420908 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.421081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.421462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.421864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.422166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.422538 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.422935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.423304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.423674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.424046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.424438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.424827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.425192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.425579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.425980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.426331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.426660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.427063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.427622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.428138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.428641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.429149 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.429685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.430065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.430446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.430839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.431344 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.431626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.432023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.432576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.433104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.433520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.433919 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 21 04:03:01.434214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94299) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 21 04:03:01.472570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94299) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 04:03:01.661537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.context [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),13ce7efe-25d0-4763-8e8a-03d9c565bf27(cell1) {{(pid=94298) load_cells /opt/stack/nova/nova/context.py:467}} Dec 21 04:03:01.669600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:01.671576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:01.672483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:01.674651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:01.701762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_db.sqlalchemy.engines [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94298) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 04:03:01.705134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_db.sqlalchemy.engines [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94298) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 04:03:01.735804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_db.sqlalchemy.engines [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94298) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 04:03:01.746401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.context [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),13ce7efe-25d0-4763-8e8a-03d9c565bf27(cell1) {{(pid=94299) load_cells /opt/stack/nova/nova/context.py:467}} Dec 21 04:03:01.753783 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:01.755766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:01.756870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:01.759086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:01.786548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94299) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 04:03:01.789759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94299) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 04:03:01.825492 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94299) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 21 04:03:01.901226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Loading Gnome Dec 21 04:03:01.922953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Loading Google Dec 21 04:03:01.926190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Loading Windows (alt) Dec 21 04:03:01.931162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Loading file Dec 21 04:03:01.932866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Loading keyczar Dec 21 04:03:01.933463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Loading multi Dec 21 04:03:01.934354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Loading pyfs Dec 21 04:03:01.990846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Loading Gnome Dec 21 04:03:02.012790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Loading Google Dec 21 04:03:02.016223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Loading Windows (alt) Dec 21 04:03:02.021570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Loading file Dec 21 04:03:02.022702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Loading keyczar Dec 21 04:03:02.023202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Loading multi Dec 21 04:03:02.024099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO keyring.backend [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Loading pyfs Dec 21 04:03:02.221069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: WARNING keystonemiddleware.auth_token [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 21 04:03:02.228233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: WARNING keystonemiddleware.auth_token [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 21 04:03:02.316400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: WARNING keystonemiddleware.auth_token [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 21 04:03:02.324309 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: WARNING keystonemiddleware.auth_token [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 21 04:03:02.563255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: WARNING keystonemiddleware.auth_token [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 21 04:03:02.569200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: WARNING keystonemiddleware.auth_token [None req-8d6c35e0-159b-4047-b6b6-6ea7dd9380a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 21 04:03:02.575564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56075e6b39c0 pid: 94298 (default app) Dec 21 04:03:02.661983 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: WARNING keystonemiddleware.auth_token [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 21 04:03:02.667815 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: WARNING keystonemiddleware.auth_token [None req-0fb91233-554e-4e6f-99f1-a0201e50f6d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 21 04:03:02.673477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56075e6b39c0 pid: 94299 (default app) Dec 21 04:03:41.932903 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2095296888", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "networks": [{"uuid": "f5464669-173e-4ece-b4c4-fcb93d733400"}]}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:03:43.227680 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] validate_networks() for [('f5464669-173e-4ece-b4c4-fcb93d733400', None, None, None)] {{(pid=94298) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:03:44.258573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1313325641", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "networks": [{"uuid": "cbe98613-5022-44ed-8fff-023841696a00"}]}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:03:44.620894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] validate_networks() for [('cbe98613-5022-44ed-8fff-023841696a00', None, None, None)] {{(pid=94299) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:03:45.680404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Flavor limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:03:45.683976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Image limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:03:45.684632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Flavor pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:03:45.685106 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Image pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:03:45.685576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:03:45.716206 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:45.716838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:45.742695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:45.744032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:45.819812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Getting quotas for project 33b459303bfe44888e8f61b8a2800f13. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:03:45.843433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Getting quotas for user c136da2277dd478bbe4a48374dcae3b8 and project 33b459303bfe44888e8f61b8a2800f13. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:03:45.864469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Going to run 1 instances... {{(pid=94298) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:03:45.867592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:03:46.062381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-15bdb175-73de-437b-8c28-d90cda11e262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.852706 Dec 21 04:03:46.063697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:03:40 2020] POST /compute/v2.1/servers => generated 380 bytes in 5855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:03:46.084627 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9610df1a-b155-48dd-a9c2-801d101bd2f5 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] Calling method '.version_select at 0x7f2bb9a90a60>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:46.251430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9610df1a-b155-48dd-a9c2-801d101bd2f5 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] 10.222.0.16 "GET /compute/v2.1/os-volumes/4ef36f90-9adb-4988-a499-89fdbee1b88f" status: 200 len: 350 microversion: 2.1 time: 0.185714 Dec 21 04:03:46.252561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:03:46 2020] GET /compute/v2.1/os-volumes/4ef36f90-9adb-4988-a499-89fdbee1b88f => generated 350 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:03:46.279371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3e17b339-4738-4203-a8a7-84d37d670e2d tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:46.283085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3e17b339-4738-4203-a8a7-84d37d670e2d tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:46.703102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Flavor limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:03:46.703753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Image limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:03:46.704285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Flavor pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:03:46.704994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Image pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:03:46.705309 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:03:46.752938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:46.755240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:46.767001 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:46.767711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:46.828381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Getting quotas for project 0d5c999358804f80929d210c54fe1fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:03:46.844183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Getting quotas for user 52adbfb830ce4351a1eca89f2e4392bb and project 0d5c999358804f80929d210c54fe1fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:03:46.876610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Going to run 1 instances... {{(pid=94299) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:03:46.893604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:03:47.022095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3e17b339-4738-4203-a8a7-84d37d670e2d tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:47.067760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3e17b339-4738-4203-a8a7-84d37d670e2d tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1215 microversion: 2.1 time: 0.813755 Dec 21 04:03:47.070345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 3/3] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:46 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1215 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:47.167226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-34982ea6-cab5-4973-8080-ddc28b69487d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.790206 Dec 21 04:03:47.179744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 1/4] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:03:43 2020] POST /compute/v2.1/servers => generated 380 bytes in 3804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:03:47.203270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3ba5c10f-856e-4df2-b6ea-29691127ae13 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:47.204057 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3ba5c10f-856e-4df2-b6ea-29691127ae13 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:47.524405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3ba5c10f-856e-4df2-b6ea-29691127ae13 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:47.546688 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3ba5c10f-856e-4df2-b6ea-29691127ae13 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1218 microversion: 2.1 time: 0.358394 Dec 21 04:03:47.567986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 4/5] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:47 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1218 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:48.105153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ba4068ea-c59d-4bdd-88bd-191425a2bd3e tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:48.105806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ba4068ea-c59d-4bdd-88bd-191425a2bd3e tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:48.584696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ba4068ea-c59d-4bdd-88bd-191425a2bd3e tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:48.587868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cb98e623-7fee-431f-b933-66de37c2f028 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:48.601918 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cb98e623-7fee-431f-b933-66de37c2f028 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:48.666157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ba4068ea-c59d-4bdd-88bd-191425a2bd3e tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1215 microversion: 2.1 time: 0.580374 Dec 21 04:03:48.666811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 2/6] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:48 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1215 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:48.716607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e8d335ea-8f02-4264-a89d-b803f89f6bf0 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] Calling method '.version_select at 0x7f2bb9a56f28>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:49.022753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e8d335ea-8f02-4264-a89d-b803f89f6bf0 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] 10.222.0.16 "GET /compute/v2.1/os-volumes/f3ce61e9-7e20-4a63-a88c-835ed1432d3f" status: 200 len: 351 microversion: 2.1 time: 0.354728 Dec 21 04:03:49.023575 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:03:48 2020] GET /compute/v2.1/os-volumes/f3ce61e9-7e20-4a63-a88c-835ed1432d3f => generated 351 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:03:49.096072 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cb98e623-7fee-431f-b933-66de37c2f028 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:49.126262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cb98e623-7fee-431f-b933-66de37c2f028 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1218 microversion: 2.1 time: 0.553490 Dec 21 04:03:49.127999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:48 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1218 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:49.689936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-61dd1403-8d33-4f59-9b9a-8642130e127a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:49.690613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-61dd1403-8d33-4f59-9b9a-8642130e127a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:49.718630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-61dd1403-8d33-4f59-9b9a-8642130e127a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:49.719444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-61dd1403-8d33-4f59-9b9a-8642130e127a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:49.720477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-61dd1403-8d33-4f59-9b9a-8642130e127a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:49.721139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-61dd1403-8d33-4f59-9b9a-8642130e127a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:50.150857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6c2298d7-85c5-4fc7-bf77-ffed45b8a036 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:50.157169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6c2298d7-85c5-4fc7-bf77-ffed45b8a036 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:50.177700 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c2298d7-85c5-4fc7-bf77-ffed45b8a036 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:50.178223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c2298d7-85c5-4fc7-bf77-ffed45b8a036 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:50.182530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c2298d7-85c5-4fc7-bf77-ffed45b8a036 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:50.183341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c2298d7-85c5-4fc7-bf77-ffed45b8a036 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:50.200013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-61dd1403-8d33-4f59-9b9a-8642130e127a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:50.230229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-61dd1403-8d33-4f59-9b9a-8642130e127a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1267 microversion: 2.1 time: 0.550248 Dec 21 04:03:50.234644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 4/9] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:49 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1267 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:50.607959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6c2298d7-85c5-4fc7-bf77-ffed45b8a036 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:50.622322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6c2298d7-85c5-4fc7-bf77-ffed45b8a036 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1214 microversion: 2.1 time: 0.481368 Dec 21 04:03:50.622963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:50 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1214 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:51.217658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-886f4056-2c13-4370-a2a6-270b5fa653b6 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] Calling method '.version_select at 0x7f2bb90fabf8>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:51.258767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-172e9bdf-8cd5-4f09-bda4-ea115386fbe4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:51.269729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-172e9bdf-8cd5-4f09-bda4-ea115386fbe4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:51.308366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-172e9bdf-8cd5-4f09-bda4-ea115386fbe4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:51.308881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-172e9bdf-8cd5-4f09-bda4-ea115386fbe4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:51.309739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-172e9bdf-8cd5-4f09-bda4-ea115386fbe4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:51.310232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-172e9bdf-8cd5-4f09-bda4-ea115386fbe4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:51.674707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-886f4056-2c13-4370-a2a6-270b5fa653b6 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] 10.222.0.16 "GET /compute/v2.1/os-volumes/92d22151-7141-4f98-9aff-5aad8ea9e52f" status: 200 len: 350 microversion: 2.1 time: 0.466669 Dec 21 04:03:51.675436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:03:51 2020] GET /compute/v2.1/os-volumes/92d22151-7141-4f98-9aff-5aad8ea9e52f => generated 350 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:03:51.695976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3a2d06d8-1013-478e-9120-961c95e5d0e4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:51.697312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3a2d06d8-1013-478e-9120-961c95e5d0e4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:51.768645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a2d06d8-1013-478e-9120-961c95e5d0e4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:51.769229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a2d06d8-1013-478e-9120-961c95e5d0e4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:51.770094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a2d06d8-1013-478e-9120-961c95e5d0e4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:51.770582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a2d06d8-1013-478e-9120-961c95e5d0e4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:51.967242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-172e9bdf-8cd5-4f09-bda4-ea115386fbe4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:52.013369 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-172e9bdf-8cd5-4f09-bda4-ea115386fbe4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1273 microversion: 2.1 time: 0.764490 Dec 21 04:03:52.021864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 7/12] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:51 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1273 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:52.040849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3a5fa0bb-8007-4d02-82f7-c195f73b56b8 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] Calling method '.version_select at 0x7f2bb90fba60>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:52.235269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3a5fa0bb-8007-4d02-82f7-c195f73b56b8 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.209065 Dec 21 04:03:52.236488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1124 bytes} [Mon Dec 21 04:03:52 2020] GET /compute/v2.1/os-volumes => generated 1034 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:52.270188 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b550b67e-4a25-436a-afe2-b54d1b1d510e tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] Calling method '.version_select at 0x7f2bb90fb9d8>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:52.561086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b550b67e-4a25-436a-afe2-b54d1b1d510e tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.315182 Dec 21 04:03:52.563317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 9/14] 10.222.0.16 () {58 vars in 1139 bytes} [Mon Dec 21 04:03:52 2020] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:03:52.580004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-20c9f711-d454-4755-b0cc-389ee9bb6204 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] Calling method '.version_select at 0x7f2bb90ef840>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:52.815440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-20c9f711-d454-4755-b0cc-389ee9bb6204 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.245138 Dec 21 04:03:52.816810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 10/15] 10.222.0.16 () {58 vars in 1124 bytes} [Mon Dec 21 04:03:52 2020] GET /compute/v2.1/os-volumes => generated 1034 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:52.840003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cba333f1-823c-45e1-9ac0-934fe47c93b9 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] Calling method '.version_select at 0x7f2bb9092378>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:52.867424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3a2d06d8-1013-478e-9120-961c95e5d0e4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:52.905063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3a2d06d8-1013-478e-9120-961c95e5d0e4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1276 microversion: 2.1 time: 1.228842 Dec 21 04:03:52.907490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 6/16] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:51 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1276 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:53.046497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3c560fc0-12f3-4b6e-8490-001713f80f06 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:53.059484 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3c560fc0-12f3-4b6e-8490-001713f80f06 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:53.064561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cba333f1-823c-45e1-9ac0-934fe47c93b9 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.238430 Dec 21 04:03:53.065465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 11/17] 10.222.0.16 () {58 vars in 1157 bytes} [Mon Dec 21 04:03:52 2020] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:03:53.083043 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c560fc0-12f3-4b6e-8490-001713f80f06 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:53.083800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c560fc0-12f3-4b6e-8490-001713f80f06 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:53.084816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c560fc0-12f3-4b6e-8490-001713f80f06 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:53.087717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d93b81a1-fee7-4186-810b-b18eaf3b3160 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] Calling method '.version_select at 0x7f2bb90eff28>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:53.088244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c560fc0-12f3-4b6e-8490-001713f80f06 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:53.346858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d93b81a1-fee7-4186-810b-b18eaf3b3160 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.271257 Dec 21 04:03:53.348433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 12/18] 10.222.0.16 () {58 vars in 1160 bytes} [Mon Dec 21 04:03:53 2020] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:03:53.383945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-056dc0ff-4e14-4869-bbf7-86520facb059 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] Calling method '.version_select at 0x7f2bb919cd08>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:53.645747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-056dc0ff-4e14-4869-bbf7-86520facb059 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.287855 Dec 21 04:03:53.646937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 13/19] 10.222.0.16 () {58 vars in 1145 bytes} [Mon Dec 21 04:03:53 2020] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:53.681401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fe3bc649-5cec-4db9-b69a-15b66ebe8819 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] Calling method '.version_select at 0x7f2bb9092620>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:53.750554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3c560fc0-12f3-4b6e-8490-001713f80f06 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:53.789395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3c560fc0-12f3-4b6e-8490-001713f80f06 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1273 microversion: 2.1 time: 0.752742 Dec 21 04:03:53.800207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 7/20] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:53 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1273 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:03:53.905472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fe3bc649-5cec-4db9-b69a-15b66ebe8819 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.248530 Dec 21 04:03:53.906137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 14/21] 10.222.0.16 () {58 vars in 1178 bytes} [Mon Dec 21 04:03:53 2020] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:03:53.926610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d323c7b9-f9a6-4030-ac1d-ec49a2915c21 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] Calling method '.version_select at 0x7f2bb90e8840>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:53.937726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-846752d7-6d1e-4bea-871c-4502492bd2cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:53.948087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-846752d7-6d1e-4bea-871c-4502492bd2cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:53.968495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-846752d7-6d1e-4bea-871c-4502492bd2cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:53.970734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-846752d7-6d1e-4bea-871c-4502492bd2cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:53.978688 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-846752d7-6d1e-4bea-871c-4502492bd2cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:53.979392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-846752d7-6d1e-4bea-871c-4502492bd2cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:54.262578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d323c7b9-f9a6-4030-ac1d-ec49a2915c21 tempest-VolumesTestJSON-582894275 tempest-VolumesTestJSON-582894275] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.348049 Dec 21 04:03:54.263502 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 8/22] 10.222.0.16 () {58 vars in 1145 bytes} [Mon Dec 21 04:03:53 2020] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:54.564178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-846752d7-6d1e-4bea-871c-4502492bd2cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:54.600146 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-846752d7-6d1e-4bea-871c-4502492bd2cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1276 microversion: 2.1 time: 0.678228 Dec 21 04:03:54.610003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 15/23] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:53 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1276 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:03:54.821190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7ee80f93-5b37-43a8-9a25-3179d12d70f6 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:54.827334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7ee80f93-5b37-43a8-9a25-3179d12d70f6 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:54.855756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7ee80f93-5b37-43a8-9a25-3179d12d70f6 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:54.859634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7ee80f93-5b37-43a8-9a25-3179d12d70f6 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:54.860766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7ee80f93-5b37-43a8-9a25-3179d12d70f6 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:54.861446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7ee80f93-5b37-43a8-9a25-3179d12d70f6 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:55.298609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7ee80f93-5b37-43a8-9a25-3179d12d70f6 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:55.328479 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7ee80f93-5b37-43a8-9a25-3179d12d70f6 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1273 microversion: 2.1 time: 0.524152 Dec 21 04:03:55.331321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 9/24] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:54 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1273 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:55.636564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5b4e7d53-0483-4fad-b647-b874d5d809d6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:55.640651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5b4e7d53-0483-4fad-b647-b874d5d809d6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:55.660938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b4e7d53-0483-4fad-b647-b874d5d809d6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:55.664290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b4e7d53-0483-4fad-b647-b874d5d809d6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:55.666736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b4e7d53-0483-4fad-b647-b874d5d809d6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:55.669868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b4e7d53-0483-4fad-b647-b874d5d809d6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:56.178825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5b4e7d53-0483-4fad-b647-b874d5d809d6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:56.207295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5b4e7d53-0483-4fad-b647-b874d5d809d6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1276 microversion: 2.1 time: 0.581213 Dec 21 04:03:56.213604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 16/25] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:55 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1276 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:56.356026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-adf4b4be-d14f-4b6f-8f24-1f2b8ebd59fe tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:56.374191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-adf4b4be-d14f-4b6f-8f24-1f2b8ebd59fe tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:56.409155 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-adf4b4be-d14f-4b6f-8f24-1f2b8ebd59fe tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:56.421079 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-adf4b4be-d14f-4b6f-8f24-1f2b8ebd59fe tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:56.422202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-adf4b4be-d14f-4b6f-8f24-1f2b8ebd59fe tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:56.428529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-adf4b4be-d14f-4b6f-8f24-1f2b8ebd59fe tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:57.239383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-29e86be3-f184-45af-b263-00c7039e1f32 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:57.249169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-29e86be3-f184-45af-b263-00c7039e1f32 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:57.263331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-29e86be3-f184-45af-b263-00c7039e1f32 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:57.264901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-29e86be3-f184-45af-b263-00c7039e1f32 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:57.272069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-29e86be3-f184-45af-b263-00c7039e1f32 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:57.273060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-29e86be3-f184-45af-b263-00c7039e1f32 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:57.369244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-adf4b4be-d14f-4b6f-8f24-1f2b8ebd59fe tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:57.395920 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-adf4b4be-d14f-4b6f-8f24-1f2b8ebd59fe tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1273 microversion: 2.1 time: 1.049870 Dec 21 04:03:57.401954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 10/26] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:56 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1273 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:57.663366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-29e86be3-f184-45af-b263-00c7039e1f32 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:57.683979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-29e86be3-f184-45af-b263-00c7039e1f32 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1276 microversion: 2.1 time: 0.455396 Dec 21 04:03:57.702042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 17/27] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:57 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1276 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:03:58.421105 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-df2c21aa-89c6-4fb0-96ab-6337e549985a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:58.421751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-df2c21aa-89c6-4fb0-96ab-6337e549985a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:58.437890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df2c21aa-89c6-4fb0-96ab-6337e549985a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:58.457381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df2c21aa-89c6-4fb0-96ab-6337e549985a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:58.459923 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df2c21aa-89c6-4fb0-96ab-6337e549985a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:58.464002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df2c21aa-89c6-4fb0-96ab-6337e549985a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:58.723490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-15df4930-a58d-4bb1-b334-ff12030d086c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:03:58.724282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-15df4930-a58d-4bb1-b334-ff12030d086c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:03:58.736087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15df4930-a58d-4bb1-b334-ff12030d086c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:58.739724 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15df4930-a58d-4bb1-b334-ff12030d086c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:58.740727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15df4930-a58d-4bb1-b334-ff12030d086c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:03:58.742504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15df4930-a58d-4bb1-b334-ff12030d086c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:03:59.120247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-15df4930-a58d-4bb1-b334-ff12030d086c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:03:59.144634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-15df4930-a58d-4bb1-b334-ff12030d086c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1276 microversion: 2.1 time: 0.436406 Dec 21 04:03:59.154215 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 18/28] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:58 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1276 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:00.172717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e17062ea-4b61-438d-9e7e-62f524a1206b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:00.179832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e17062ea-4b61-438d-9e7e-62f524a1206b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:00.202852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e17062ea-4b61-438d-9e7e-62f524a1206b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:00.203817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e17062ea-4b61-438d-9e7e-62f524a1206b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:00.206234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e17062ea-4b61-438d-9e7e-62f524a1206b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:00.208211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e17062ea-4b61-438d-9e7e-62f524a1206b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:00.448576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e17062ea-4b61-438d-9e7e-62f524a1206b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:00.475155 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e17062ea-4b61-438d-9e7e-62f524a1206b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1276 microversion: 2.1 time: 0.314193 Dec 21 04:04:00.475941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 19/29] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:00 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1276 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:01.500457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bc05af30-5295-4022-a4c0-dcbe54251473 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:01.501132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bc05af30-5295-4022-a4c0-dcbe54251473 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:01.531230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc05af30-5295-4022-a4c0-dcbe54251473 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:01.533227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc05af30-5295-4022-a4c0-dcbe54251473 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:01.536200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc05af30-5295-4022-a4c0-dcbe54251473 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:01.537295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc05af30-5295-4022-a4c0-dcbe54251473 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:02.250578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-df2c21aa-89c6-4fb0-96ab-6337e549985a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:02.272230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-df2c21aa-89c6-4fb0-96ab-6337e549985a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 3.862642 Dec 21 04:04:02.287901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 11/30] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:03:58 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 3879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:03.307992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8541e8cf-780d-4f64-8b39-051dfbc648c5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:03.321769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8541e8cf-780d-4f64-8b39-051dfbc648c5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:03.365674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8541e8cf-780d-4f64-8b39-051dfbc648c5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:03.366209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8541e8cf-780d-4f64-8b39-051dfbc648c5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:03.367137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8541e8cf-780d-4f64-8b39-051dfbc648c5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:03.367637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8541e8cf-780d-4f64-8b39-051dfbc648c5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:03.716457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bc05af30-5295-4022-a4c0-dcbe54251473 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:03.757875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bc05af30-5295-4022-a4c0-dcbe54251473 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 2.263709 Dec 21 04:04:03.759313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 20/31] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:01 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 2270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:04.784077 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1155ee9c-570d-42f1-bf75-7237ca898780 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:04.790575 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1155ee9c-570d-42f1-bf75-7237ca898780 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:04.809786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1155ee9c-570d-42f1-bf75-7237ca898780 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:04.810695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1155ee9c-570d-42f1-bf75-7237ca898780 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:04.811819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1155ee9c-570d-42f1-bf75-7237ca898780 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:04.812871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1155ee9c-570d-42f1-bf75-7237ca898780 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:05.224242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1155ee9c-570d-42f1-bf75-7237ca898780 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:05.234098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1155ee9c-570d-42f1-bf75-7237ca898780 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 0.460876 Dec 21 04:04:05.234953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 21/32] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:04 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:05.360525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8541e8cf-780d-4f64-8b39-051dfbc648c5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:05.385694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8541e8cf-780d-4f64-8b39-051dfbc648c5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 2.091455 Dec 21 04:04:05.386628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 12/33] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:03 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:05.740559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2add293b-d5cd-40ee-bf19-f75de9dd65d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'create', calling method: .version_select at 0x7f2bb90fbd08>, body: {"keypair": {"name": "tempest-keypair-1110262630"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:05.830514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-2add293b-d5cd-40ee-bf19-f75de9dd65d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Getting quotas for project cc8f76dafd9d4e19a9667dec5becb673. Resources: {'key_pairs'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:04:05.836186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-2add293b-d5cd-40ee-bf19-f75de9dd65d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Getting quotas for user 72d106173cd04d2e839770d14d8731a5 and project cc8f76dafd9d4e19a9667dec5becb673. Resources: {'key_pairs'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:04:06.184932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4005f167-9907-4a4e-985b-b47faecabe0f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'create', calling method: .version_select at 0x7f2bb90fa950>, body: {"keypair": {"name": "tempest-keypair-1161064162"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:06.272677 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-2add293b-d5cd-40ee-bf19-f75de9dd65d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Getting quotas for project cc8f76dafd9d4e19a9667dec5becb673. Resources: {'key_pairs'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:04:06.285849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-2add293b-d5cd-40ee-bf19-f75de9dd65d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Getting quotas for user 72d106173cd04d2e839770d14d8731a5 and project cc8f76dafd9d4e19a9667dec5becb673. Resources: {'key_pairs'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:04:06.309075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-4005f167-9907-4a4e-985b-b47faecabe0f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Getting quotas for project f527547042444d469350a38850143d5a. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:04:06.318570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-4005f167-9907-4a4e-985b-b47faecabe0f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Getting quotas for user bc28a0b363024c9d97f3be0a04b1bd33 and project f527547042444d469350a38850143d5a. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:04:06.322488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2add293b-d5cd-40ee-bf19-f75de9dd65d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.011867 Dec 21 04:04:06.326491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 22/34] 10.222.0.16 () {62 vars in 1189 bytes} [Mon Dec 21 04:04:05 2020] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1017 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 21 04:04:06.348520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-83926ac8-f22d-4678-af51-65504ea936da tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:06.349197 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-83926ac8-f22d-4678-af51-65504ea936da tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:06.366578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83926ac8-f22d-4678-af51-65504ea936da tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:06.371521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83926ac8-f22d-4678-af51-65504ea936da tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:06.372410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83926ac8-f22d-4678-af51-65504ea936da tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:06.372912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83926ac8-f22d-4678-af51-65504ea936da tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:06.635033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-4005f167-9907-4a4e-985b-b47faecabe0f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Getting quotas for project f527547042444d469350a38850143d5a. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:04:06.643947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-4005f167-9907-4a4e-985b-b47faecabe0f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Getting quotas for user bc28a0b363024c9d97f3be0a04b1bd33 and project f527547042444d469350a38850143d5a. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:04:06.674052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4005f167-9907-4a4e-985b-b47faecabe0f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.716180 Dec 21 04:04:06.674988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 13/35] 10.222.0.16 () {60 vars in 1148 bytes} [Mon Dec 21 04:04:05 2020] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:06.686271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-653fe186-672f-4b8c-a17d-9b9daa5f72e3 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:06.687135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-653fe186-672f-4b8c-a17d-9b9daa5f72e3 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:06.698434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-653fe186-672f-4b8c-a17d-9b9daa5f72e3 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:06.699253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-653fe186-672f-4b8c-a17d-9b9daa5f72e3 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:06.700503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-653fe186-672f-4b8c-a17d-9b9daa5f72e3 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:06.701173 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-653fe186-672f-4b8c-a17d-9b9daa5f72e3 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:07.013830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-83926ac8-f22d-4678-af51-65504ea936da tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:07.035241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-83926ac8-f22d-4678-af51-65504ea936da tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 0.707439 Dec 21 04:04:07.037279 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 23/36] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:06 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:07.998874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-653fe186-672f-4b8c-a17d-9b9daa5f72e3 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:08.016892 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-653fe186-672f-4b8c-a17d-9b9daa5f72e3 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 1.340598 Dec 21 04:04:08.017493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 14/37] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:06 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:08.067805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7810f17e-0d64-4221-8555-6bd121d1d02e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:08.070119 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7810f17e-0d64-4221-8555-6bd121d1d02e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:08.094424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7810f17e-0d64-4221-8555-6bd121d1d02e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:08.096126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7810f17e-0d64-4221-8555-6bd121d1d02e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:08.098394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7810f17e-0d64-4221-8555-6bd121d1d02e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:08.098928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7810f17e-0d64-4221-8555-6bd121d1d02e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:08.408264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-407915739", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2c2a6e4-9130-437b-b1c6-0bb90f013677"}]}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:08.585562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] validate_networks() for [('e2c2a6e4-9130-437b-b1c6-0bb90f013677', None, None, None)] {{(pid=94298) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:04:10.772852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7810f17e-0d64-4221-8555-6bd121d1d02e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:10.791615 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7810f17e-0d64-4221-8555-6bd121d1d02e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 2.732810 Dec 21 04:04:10.792827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 15/38] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:08 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 2738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:10.807259 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c3a72117-fd8d-4963-a0dd-898ec07bc78e tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:10.808215 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c3a72117-fd8d-4963-a0dd-898ec07bc78e tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:10.823218 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c3a72117-fd8d-4963-a0dd-898ec07bc78e tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:10.823903 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c3a72117-fd8d-4963-a0dd-898ec07bc78e tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:10.824968 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c3a72117-fd8d-4963-a0dd-898ec07bc78e tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:10.825471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c3a72117-fd8d-4963-a0dd-898ec07bc78e tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:10.877476 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Flavor limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:04:10.878545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Image limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:04:10.879305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Flavor pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:04:10.881014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Image pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:04:10.881860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:04:10.913823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:10.915491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:10.916585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:10.917256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:10.965647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Getting quotas for project 835bff285f30412e8cdd0e7f8f00f705. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:04:10.980193 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Getting quotas for user 9969a42d296a4ca0af35e1af6e473f46 and project 835bff285f30412e8cdd0e7f8f00f705. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:04:11.011442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Going to run 1 instances... {{(pid=94298) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:04:11.016845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:04:11.149663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-674f9f8f-7bca-403f-a84d-123002fc2984 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.362643 Dec 21 04:04:11.153582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 24/39] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:04:07 2020] POST /compute/v2.1/servers => generated 383 bytes in 3367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 21 04:04:11.206946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7854186b-9f41-46c7-9cc3-07977b79770a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:11.207933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7854186b-9f41-46c7-9cc3-07977b79770a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:11.544660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7854186b-9f41-46c7-9cc3-07977b79770a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:11.570423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7854186b-9f41-46c7-9cc3-07977b79770a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1221 microversion: 2.1 time: 0.407761 Dec 21 04:04:11.589452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 25/40] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:11 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1221 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:11.815473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7b3c570e-151f-4239-af41-4222b67143b7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:11.818468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7b3c570e-151f-4239-af41-4222b67143b7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:11.844962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b3c570e-151f-4239-af41-4222b67143b7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:11.852031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b3c570e-151f-4239-af41-4222b67143b7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:11.854679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b3c570e-151f-4239-af41-4222b67143b7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:11.855404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b3c570e-151f-4239-af41-4222b67143b7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:12.647121 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7b3c570e-151f-4239-af41-4222b67143b7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:12.667671 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7b3c570e-151f-4239-af41-4222b67143b7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 0.860318 Dec 21 04:04:12.668614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 26/41] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:11 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:12.701800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-27274316", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2c2a6e4-9130-437b-b1c6-0bb90f013677"}]}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:12.730569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c3a72117-fd8d-4963-a0dd-898ec07bc78e tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:12.752816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c3a72117-fd8d-4963-a0dd-898ec07bc78e tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 1.958092 Dec 21 04:04:12.756645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 16/42] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:10 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:12.787579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1374622318", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8d33767-b253-441c-91c7-8b1cb39a6139"}], "security_groups": [{"name": "tempest-securitygroup--1256454459"}], "key_name": "tempest-keypair-1161064162", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:12.878944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] validate_networks() for [('e2c2a6e4-9130-437b-b1c6-0bb90f013677', None, None, None)] {{(pid=94298) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:04:13.394852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] validate_networks() for [('e8d33767-b253-441c-91c7-8b1cb39a6139', None, None, None)] {{(pid=94299) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:04:14.149971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Flavor limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:04:14.150683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Image limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:04:14.151620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Flavor pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:04:14.152489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Image pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:04:14.153154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:04:14.168927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:14.169613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:14.170604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:14.173225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:14.203081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Getting quotas for project 835bff285f30412e8cdd0e7f8f00f705. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:04:14.207933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Getting quotas for user 9969a42d296a4ca0af35e1af6e473f46 and project 835bff285f30412e8cdd0e7f8f00f705. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:04:14.223998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Going to run 1 instances... {{(pid=94298) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:04:14.228186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:04:14.299472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f3babc39-067c-40f8-9c64-72b4691c7c26 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.625461 Dec 21 04:04:14.306587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 27/43] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:04:12 2020] POST /compute/v2.1/servers => generated 383 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:04:14.452664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-9f0bff9f-4aec-45dd-a7dc-0fa55a79cd98 req-3e94e877-26d6-47c2-8cb6-ee79d640beea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "658a086f-4f18-4fe0-a27b-c88bdf8bba38", "tag": "c3d06276-942a-422b-add5-5fb80a8c96cc"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:14.489315 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:14.489315 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:14.525181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-9f0bff9f-4aec-45dd-a7dc-0fa55a79cd98 req-3e94e877-26d6-47c2-8cb6-ee79d640beea service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:14.529077 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-9f0bff9f-4aec-45dd-a7dc-0fa55a79cd98 req-3e94e877-26d6-47c2-8cb6-ee79d640beea service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:14.576029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-9f0bff9f-4aec-45dd-a7dc-0fa55a79cd98 req-3e94e877-26d6-47c2-8cb6-ee79d640beea service nova] Creating event network-changed:c3d06276-942a-422b-add5-5fb80a8c96cc for instance 658a086f-4f18-4fe0-a27b-c88bdf8bba38 on hv-cinder-73306 Dec 21 04:04:14.577426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-9f0bff9f-4aec-45dd-a7dc-0fa55a79cd98 req-3e94e877-26d6-47c2-8cb6-ee79d640beea service nova] Acquired lock "compute-rpcapi-router" {{(pid=94298) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 21 04:04:14.578857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f05c4b94-330f-443e-8ee5-9b692baee40e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:14.579582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f05c4b94-330f-443e-8ee5-9b692baee40e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:14.580636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f05c4b94-330f-443e-8ee5-9b692baee40e None None] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:14.581320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f05c4b94-330f-443e-8ee5-9b692baee40e None None] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:14.599584 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.compute.rpcapi [None req-f05c4b94-330f-443e-8ee5-9b692baee40e None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 21 04:04:14.600840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f05c4b94-330f-443e-8ee5-9b692baee40e None None] Releasing lock "compute-rpcapi-router" {{(pid=94298) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 21 04:04:14.655990 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f05c4b94-330f-443e-8ee5-9b692baee40e None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347659 Dec 21 04:04:14.656625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 28/44] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:14 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:14.691077 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9ed232ce-952b-486d-882b-dd1c32efe2cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:14.692129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9ed232ce-952b-486d-882b-dd1c32efe2cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:14.718164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9ed232ce-952b-486d-882b-dd1c32efe2cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:14.719112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9ed232ce-952b-486d-882b-dd1c32efe2cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:14.722067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9ed232ce-952b-486d-882b-dd1c32efe2cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:14.723150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9ed232ce-952b-486d-882b-dd1c32efe2cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:15.027353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9ed232ce-952b-486d-882b-dd1c32efe2cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:15.039080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9ed232ce-952b-486d-882b-dd1c32efe2cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 0.375008 Dec 21 04:04:15.039829 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 29/45] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:14 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:15.052453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-83c49b91-9984-4c4e-a518-3b67d107cbe9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:15.053216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-83c49b91-9984-4c4e-a518-3b67d107cbe9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:15.063634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83c49b91-9984-4c4e-a518-3b67d107cbe9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:15.064195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83c49b91-9984-4c4e-a518-3b67d107cbe9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:15.065049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83c49b91-9984-4c4e-a518-3b67d107cbe9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:15.066258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83c49b91-9984-4c4e-a518-3b67d107cbe9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:15.646111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-83c49b91-9984-4c4e-a518-3b67d107cbe9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:15.657768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-83c49b91-9984-4c4e-a518-3b67d107cbe9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 0.616738 Dec 21 04:04:15.668381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 30/46] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:15 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:15.670142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-15546704-bf14-4cc4-b76b-4f2d5cedb21b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:15.670815 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-15546704-bf14-4cc4-b76b-4f2d5cedb21b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:15.716869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15546704-bf14-4cc4-b76b-4f2d5cedb21b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:15.717512 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15546704-bf14-4cc4-b76b-4f2d5cedb21b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:15.718230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15546704-bf14-4cc4-b76b-4f2d5cedb21b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:15.718729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15546704-bf14-4cc4-b76b-4f2d5cedb21b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:16.378054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-15546704-bf14-4cc4-b76b-4f2d5cedb21b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:16.392233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-15546704-bf14-4cc4-b76b-4f2d5cedb21b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1216 microversion: 2.1 time: 0.732244 Dec 21 04:04:16.396638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 31/47] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:15 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1216 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:16.412796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-664fdf6d-ad87-4aa1-b2cc-ea95746246af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:16.413453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-664fdf6d-ad87-4aa1-b2cc-ea95746246af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:16.432016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-664fdf6d-ad87-4aa1-b2cc-ea95746246af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:16.432528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-664fdf6d-ad87-4aa1-b2cc-ea95746246af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:16.433382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-664fdf6d-ad87-4aa1-b2cc-ea95746246af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:16.433875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-664fdf6d-ad87-4aa1-b2cc-ea95746246af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:16.661998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Flavor limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:04:16.662452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Image limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:04:16.663187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Flavor pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:04:16.663844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Image pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:04:16.664348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:04:16.674730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:16.675551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:16.676627 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:16.677355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:16.702080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-664fdf6d-ad87-4aa1-b2cc-ea95746246af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:16.704674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Getting quotas for project f527547042444d469350a38850143d5a. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:04:16.710261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Getting quotas for user bc28a0b363024c9d97f3be0a04b1bd33 and project f527547042444d469350a38850143d5a. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:04:16.716420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-664fdf6d-ad87-4aa1-b2cc-ea95746246af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 0.318543 Dec 21 04:04:16.717160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 32/48] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:16 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:16.726182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Going to run 1 instances... {{(pid=94299) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:04:16.729594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:04:16.737644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c8ffc4db-eee3-4f07-8fa6-9e56cfbaa1c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:16.738487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c8ffc4db-eee3-4f07-8fa6-9e56cfbaa1c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:16.747770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8ffc4db-eee3-4f07-8fa6-9e56cfbaa1c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:16.748520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8ffc4db-eee3-4f07-8fa6-9e56cfbaa1c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:16.749703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8ffc4db-eee3-4f07-8fa6-9e56cfbaa1c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:16.750371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8ffc4db-eee3-4f07-8fa6-9e56cfbaa1c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:16.805215 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-47b8eec7-2ea0-4c90-9940-30d38532be65 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.046503 Dec 21 04:04:16.806344 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 17/49] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:04:12 2020] POST /compute/v2.1/servers => generated 402 bytes in 4048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:04:16.833625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-4536dfbe-6629-47c2-8c34-7f0e0a23610e req-ecd63697-3a75-4481-9db9-68fb45ff793b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7310cf50-d008-4e86-94b0-9a1a0e0c8fad", "tag": "e659557b-9fe0-4ca8-b96e-86df08ff2db2"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:16.843654 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:16.843654 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:16.854576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-4536dfbe-6629-47c2-8c34-7f0e0a23610e req-ecd63697-3a75-4481-9db9-68fb45ff793b service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:16.855093 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-4536dfbe-6629-47c2-8c34-7f0e0a23610e req-ecd63697-3a75-4481-9db9-68fb45ff793b service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:16.877504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-4536dfbe-6629-47c2-8c34-7f0e0a23610e req-ecd63697-3a75-4481-9db9-68fb45ff793b service nova] Creating event network-changed:e659557b-9fe0-4ca8-b96e-86df08ff2db2 for instance 7310cf50-d008-4e86-94b0-9a1a0e0c8fad on hv-cinder-73306 Dec 21 04:04:16.878297 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-4536dfbe-6629-47c2-8c34-7f0e0a23610e req-ecd63697-3a75-4481-9db9-68fb45ff793b service nova] Acquired lock "compute-rpcapi-router" {{(pid=94299) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 21 04:04:16.879916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f72c2d8f-cbf5-44cb-9e9b-c5228fc97102 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:16.880534 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f72c2d8f-cbf5-44cb-9e9b-c5228fc97102 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:16.881514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f72c2d8f-cbf5-44cb-9e9b-c5228fc97102 None None] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:16.882224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f72c2d8f-cbf5-44cb-9e9b-c5228fc97102 None None] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:16.893500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.compute.rpcapi [None req-f72c2d8f-cbf5-44cb-9e9b-c5228fc97102 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 21 04:04:16.895012 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f72c2d8f-cbf5-44cb-9e9b-c5228fc97102 None None] Releasing lock "compute-rpcapi-router" {{(pid=94299) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 21 04:04:16.936686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f72c2d8f-cbf5-44cb-9e9b-c5228fc97102 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116002 Dec 21 04:04:16.937806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 18/50] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:16 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:16.950345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-52419012-c556-46b3-8da7-8cf302d4f0f4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:16.951519 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-52419012-c556-46b3-8da7-8cf302d4f0f4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:17.017915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c8ffc4db-eee3-4f07-8fa6-9e56cfbaa1c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:17.028024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c8ffc4db-eee3-4f07-8fa6-9e56cfbaa1c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 0.309739 Dec 21 04:04:17.028752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 33/51] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:16 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:17.063228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-52419012-c556-46b3-8da7-8cf302d4f0f4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:17.074320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-52419012-c556-46b3-8da7-8cf302d4f0f4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1238 microversion: 2.1 time: 0.135200 Dec 21 04:04:17.075071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 19/52] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:16 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1238 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:17.216091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1643343056", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6bc0051-d4ea-476a-9024-7792973f8f69"}], "security_groups": [{"name": "tempest-securitygroup--1936529947"}], "key_name": "tempest-keypair-1110262630", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:17.367308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] validate_networks() for [('f6bc0051-d4ea-476a-9024-7792973f8f69', None, None, None)] {{(pid=94298) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:04:17.415180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-98df147a-b99c-4d2d-84c0-311a24dbe35b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:17.415849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-98df147a-b99c-4d2d-84c0-311a24dbe35b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:17.423893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-98df147a-b99c-4d2d-84c0-311a24dbe35b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:17.426048 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-98df147a-b99c-4d2d-84c0-311a24dbe35b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:17.426926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-98df147a-b99c-4d2d-84c0-311a24dbe35b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:17.427426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-98df147a-b99c-4d2d-84c0-311a24dbe35b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:17.643204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-98df147a-b99c-4d2d-84c0-311a24dbe35b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:17.669927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-98df147a-b99c-4d2d-84c0-311a24dbe35b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1216 microversion: 2.1 time: 0.263967 Dec 21 04:04:17.670701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 20/53] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:17 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1216 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:17.741614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d8d80b69-f93d-4c14-928e-d2a5fefa34b5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:17.742282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d8d80b69-f93d-4c14-928e-d2a5fefa34b5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:17.751167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d8d80b69-f93d-4c14-928e-d2a5fefa34b5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:17.751752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d8d80b69-f93d-4c14-928e-d2a5fefa34b5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:17.752634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d8d80b69-f93d-4c14-928e-d2a5fefa34b5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:17.753186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d8d80b69-f93d-4c14-928e-d2a5fefa34b5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:17.989623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d8d80b69-f93d-4c14-928e-d2a5fefa34b5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:18.018339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d8d80b69-f93d-4c14-928e-d2a5fefa34b5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 0.286656 Dec 21 04:04:18.019011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 21/54] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:17 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:18.051577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cc415aee-44de-440c-8da3-8ef4eadbefbf tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:18.054288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cc415aee-44de-440c-8da3-8ef4eadbefbf tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:18.072041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cc415aee-44de-440c-8da3-8ef4eadbefbf tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:18.072539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cc415aee-44de-440c-8da3-8ef4eadbefbf tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:18.073378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cc415aee-44de-440c-8da3-8ef4eadbefbf tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:18.073864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cc415aee-44de-440c-8da3-8ef4eadbefbf tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:18.148859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Flavor limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:04:18.149803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Image limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:04:18.150566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Flavor pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:04:18.151039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Image pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:04:18.151724 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:04:18.163456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:18.164718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:18.166357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:18.167212 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:18.189845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Getting quotas for project cc8f76dafd9d4e19a9667dec5becb673. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:04:18.194476 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Getting quotas for user 72d106173cd04d2e839770d14d8731a5 and project cc8f76dafd9d4e19a9667dec5becb673. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:04:18.207759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Going to run 1 instances... {{(pid=94298) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:04:18.210668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:04:18.304431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ffb4473f-4593-4f0e-812f-24c4c56e35cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.097658 Dec 21 04:04:18.305843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 34/55] 10.222.0.16 () {62 vars in 1178 bytes} [Mon Dec 21 04:04:17 2020] POST /compute/v2.1/servers => generated 402 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 21 04:04:18.348691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-243cd188-de3f-4dfc-8bb6-8370405412c1 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:18.349389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-243cd188-de3f-4dfc-8bb6-8370405412c1 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:18.392741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-243cd188-de3f-4dfc-8bb6-8370405412c1 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:18.399580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-243cd188-de3f-4dfc-8bb6-8370405412c1 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:18.400491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-243cd188-de3f-4dfc-8bb6-8370405412c1 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:18.401003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-243cd188-de3f-4dfc-8bb6-8370405412c1 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:18.681275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-243cd188-de3f-4dfc-8bb6-8370405412c1 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:18.705986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-243cd188-de3f-4dfc-8bb6-8370405412c1 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1234 microversion: 2.1 time: 0.383823 Dec 21 04:04:18.707382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 35/56] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:18 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1234 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:18.723252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9754ba80-0961-4d2b-8eb1-e436c2b69310 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:18.724349 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9754ba80-0961-4d2b-8eb1-e436c2b69310 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:19.075285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cc415aee-44de-440c-8da3-8ef4eadbefbf tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:19.094168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cc415aee-44de-440c-8da3-8ef4eadbefbf tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 1.051794 Dec 21 04:04:19.100397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 22/57] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:18 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:19.124315 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5e617fc7-9076-476a-a74f-d343c5ee8e0b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:19.130709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5e617fc7-9076-476a-a74f-d343c5ee8e0b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:19.151977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e617fc7-9076-476a-a74f-d343c5ee8e0b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:19.151977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e617fc7-9076-476a-a74f-d343c5ee8e0b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:19.152789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e617fc7-9076-476a-a74f-d343c5ee8e0b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:19.153283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e617fc7-9076-476a-a74f-d343c5ee8e0b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:19.191226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9754ba80-0961-4d2b-8eb1-e436c2b69310 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:19.221740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9754ba80-0961-4d2b-8eb1-e436c2b69310 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:19.242874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9754ba80-0961-4d2b-8eb1-e436c2b69310 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:19.244312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9754ba80-0961-4d2b-8eb1-e436c2b69310 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1282 microversion: 2.20 time: 0.534757 Dec 21 04:04:19.245139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 36/58] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:18 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1282 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:19.271202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ef6d1b1d-b301-4c41-a493-6e61cd90e194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:19.271885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ef6d1b1d-b301-4c41-a493-6e61cd90e194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:19.301402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef6d1b1d-b301-4c41-a493-6e61cd90e194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:19.301894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef6d1b1d-b301-4c41-a493-6e61cd90e194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:19.305849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef6d1b1d-b301-4c41-a493-6e61cd90e194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:19.312818 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef6d1b1d-b301-4c41-a493-6e61cd90e194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:19.458794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5e617fc7-9076-476a-a74f-d343c5ee8e0b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:19.476952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5e617fc7-9076-476a-a74f-d343c5ee8e0b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1280 microversion: 2.1 time: 0.375270 Dec 21 04:04:19.491950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 23/59] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:19 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1280 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:19.739323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e4cf087a-d8fc-4756-b7e2-2be5f5ccc6f0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:19.740923 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e4cf087a-d8fc-4756-b7e2-2be5f5ccc6f0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:19.763766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4cf087a-d8fc-4756-b7e2-2be5f5ccc6f0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:19.764587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4cf087a-d8fc-4756-b7e2-2be5f5ccc6f0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:19.766686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4cf087a-d8fc-4756-b7e2-2be5f5ccc6f0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:19.773306 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4cf087a-d8fc-4756-b7e2-2be5f5ccc6f0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:20.085280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e4cf087a-d8fc-4756-b7e2-2be5f5ccc6f0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:20.106727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e4cf087a-d8fc-4756-b7e2-2be5f5ccc6f0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1290 microversion: 2.1 time: 0.384844 Dec 21 04:04:20.109417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 24/60] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:19 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1290 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:20.127745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-21b85be7-a121-455d-b7d5-eeac139edde7 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:20.128714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-21b85be7-a121-455d-b7d5-eeac139edde7 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:20.137832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-21b85be7-a121-455d-b7d5-eeac139edde7 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:20.138687 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-21b85be7-a121-455d-b7d5-eeac139edde7 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:20.139919 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-21b85be7-a121-455d-b7d5-eeac139edde7 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:20.140842 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-21b85be7-a121-455d-b7d5-eeac139edde7 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:20.244397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ef6d1b1d-b301-4c41-a493-6e61cd90e194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:20.265216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ef6d1b1d-b301-4c41-a493-6e61cd90e194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 1.011778 Dec 21 04:04:20.269866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 37/61] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:19 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:20.296280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d62e83f1-a59b-4eb2-8909-7ee87f05e48f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:20.297235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d62e83f1-a59b-4eb2-8909-7ee87f05e48f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:20.309025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d62e83f1-a59b-4eb2-8909-7ee87f05e48f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:20.309525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d62e83f1-a59b-4eb2-8909-7ee87f05e48f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:20.310536 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d62e83f1-a59b-4eb2-8909-7ee87f05e48f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:20.321527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d62e83f1-a59b-4eb2-8909-7ee87f05e48f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:20.606631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d62e83f1-a59b-4eb2-8909-7ee87f05e48f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:20.625090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d62e83f1-a59b-4eb2-8909-7ee87f05e48f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:20.632469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d62e83f1-a59b-4eb2-8909-7ee87f05e48f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:20.634836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d62e83f1-a59b-4eb2-8909-7ee87f05e48f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1334 microversion: 2.20 time: 0.362989 Dec 21 04:04:20.641557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 38/62] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:20 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1334 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:20.652670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5e568644-320d-489e-a57f-a6e8a7fce899 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:20.666926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5e568644-320d-489e-a57f-a6e8a7fce899 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:20.682192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e568644-320d-489e-a57f-a6e8a7fce899 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:20.687157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e568644-320d-489e-a57f-a6e8a7fce899 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:20.688536 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e568644-320d-489e-a57f-a6e8a7fce899 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:20.689250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e568644-320d-489e-a57f-a6e8a7fce899 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:20.903942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-21b85be7-a121-455d-b7d5-eeac139edde7 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:20.925302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-21b85be7-a121-455d-b7d5-eeac139edde7 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 0.810713 Dec 21 04:04:20.926064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 25/63] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:20 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:21.045404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5e568644-320d-489e-a57f-a6e8a7fce899 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:21.066217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5e568644-320d-489e-a57f-a6e8a7fce899 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1278 microversion: 2.1 time: 0.423255 Dec 21 04:04:21.066838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 39/64] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:20 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1278 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:21.131616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d138e7ca-d9b0-4e8f-887b-0152a3eafb1e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:21.136690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d138e7ca-d9b0-4e8f-887b-0152a3eafb1e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:21.151671 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d138e7ca-d9b0-4e8f-887b-0152a3eafb1e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:21.152188 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d138e7ca-d9b0-4e8f-887b-0152a3eafb1e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:21.153016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d138e7ca-d9b0-4e8f-887b-0152a3eafb1e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:21.159153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d138e7ca-d9b0-4e8f-887b-0152a3eafb1e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:21.294278 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a4373901-4321-4149-bb51-8e97d0200c9a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:21.296050 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a4373901-4321-4149-bb51-8e97d0200c9a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:21.314189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4373901-4321-4149-bb51-8e97d0200c9a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:21.317446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4373901-4321-4149-bb51-8e97d0200c9a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:21.318553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4373901-4321-4149-bb51-8e97d0200c9a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:21.319947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4373901-4321-4149-bb51-8e97d0200c9a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:21.691373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d138e7ca-d9b0-4e8f-887b-0152a3eafb1e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:21.702115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d138e7ca-d9b0-4e8f-887b-0152a3eafb1e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1296 microversion: 2.1 time: 0.580103 Dec 21 04:04:21.702744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 26/65] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:21 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1296 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:21.713998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b70fe2da-183b-48f0-b31f-733a12afe107 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:21.714955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b70fe2da-183b-48f0-b31f-733a12afe107 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:21.723371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b70fe2da-183b-48f0-b31f-733a12afe107 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:21.724378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b70fe2da-183b-48f0-b31f-733a12afe107 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:21.725550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b70fe2da-183b-48f0-b31f-733a12afe107 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:21.726217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b70fe2da-183b-48f0-b31f-733a12afe107 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:21.903466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b70fe2da-183b-48f0-b31f-733a12afe107 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:21.919572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b70fe2da-183b-48f0-b31f-733a12afe107 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:21.926969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b70fe2da-183b-48f0-b31f-733a12afe107 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:21.927699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b70fe2da-183b-48f0-b31f-733a12afe107 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1340 microversion: 2.20 time: 0.223611 Dec 21 04:04:21.930296 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 27/66] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:21 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1340 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:21.953911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-683871b7-f843-4301-ae14-a9b2b35494c9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:21.954695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-683871b7-f843-4301-ae14-a9b2b35494c9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:21.964771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-683871b7-f843-4301-ae14-a9b2b35494c9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:21.965290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-683871b7-f843-4301-ae14-a9b2b35494c9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:21.966299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-683871b7-f843-4301-ae14-a9b2b35494c9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:21.966799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-683871b7-f843-4301-ae14-a9b2b35494c9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:22.296289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a4373901-4321-4149-bb51-8e97d0200c9a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:22.306203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a4373901-4321-4149-bb51-8e97d0200c9a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 1.021935 Dec 21 04:04:22.307253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 40/67] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:21 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:22.318067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-683871b7-f843-4301-ae14-a9b2b35494c9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:22.333922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-683871b7-f843-4301-ae14-a9b2b35494c9 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 0.392731 Dec 21 04:04:22.334537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 28/68] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:21 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:22.338441 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-04cd2dd6-4578-4a99-b959-11ac674be6fd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:22.339122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-04cd2dd6-4578-4a99-b959-11ac674be6fd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:22.347572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-04cd2dd6-4578-4a99-b959-11ac674be6fd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:22.348112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-04cd2dd6-4578-4a99-b959-11ac674be6fd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:22.348929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-04cd2dd6-4578-4a99-b959-11ac674be6fd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:22.349418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-04cd2dd6-4578-4a99-b959-11ac674be6fd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:22.602773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-04cd2dd6-4578-4a99-b959-11ac674be6fd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:22.613979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-04cd2dd6-4578-4a99-b959-11ac674be6fd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1278 microversion: 2.1 time: 0.305516 Dec 21 04:04:22.615809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 41/69] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:22 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1278 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:22.736408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f0bf8647-1d08-4caf-b972-cd62117fc937 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:22.737270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f0bf8647-1d08-4caf-b972-cd62117fc937 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:22.750761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0bf8647-1d08-4caf-b972-cd62117fc937 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:22.751792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0bf8647-1d08-4caf-b972-cd62117fc937 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:22.753139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0bf8647-1d08-4caf-b972-cd62117fc937 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:22.754055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0bf8647-1d08-4caf-b972-cd62117fc937 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:22.955756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bf1a1d1b-04b5-4131-94f0-d71b8a1ebd18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:22.957270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bf1a1d1b-04b5-4131-94f0-d71b8a1ebd18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:22.967818 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf1a1d1b-04b5-4131-94f0-d71b8a1ebd18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:22.968581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf1a1d1b-04b5-4131-94f0-d71b8a1ebd18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:22.969872 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf1a1d1b-04b5-4131-94f0-d71b8a1ebd18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:22.970564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf1a1d1b-04b5-4131-94f0-d71b8a1ebd18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:22.978707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f0bf8647-1d08-4caf-b972-cd62117fc937 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:22.999315 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f0bf8647-1d08-4caf-b972-cd62117fc937 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1296 microversion: 2.1 time: 0.281273 Dec 21 04:04:23.011752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 29/70] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:22 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1296 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:23.216249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bf1a1d1b-04b5-4131-94f0-d71b8a1ebd18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:23.230871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bf1a1d1b-04b5-4131-94f0-d71b8a1ebd18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:23.237720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bf1a1d1b-04b5-4131-94f0-d71b8a1ebd18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:23.239011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bf1a1d1b-04b5-4131-94f0-d71b8a1ebd18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1340 microversion: 2.20 time: 0.293789 Dec 21 04:04:23.239706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 42/71] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:22 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1340 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:23.331539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0f5fa121-d759-4372-8bdb-7adb433b7a82 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:23.332211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0f5fa121-d759-4372-8bdb-7adb433b7a82 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:23.341462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f5fa121-d759-4372-8bdb-7adb433b7a82 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:23.342409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f5fa121-d759-4372-8bdb-7adb433b7a82 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:23.343451 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f5fa121-d759-4372-8bdb-7adb433b7a82 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:23.344131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f5fa121-d759-4372-8bdb-7adb433b7a82 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:23.357917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5dcf0e20-689e-40bb-8352-26cf0f9e8035 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:23.358593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5dcf0e20-689e-40bb-8352-26cf0f9e8035 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:23.388637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5dcf0e20-689e-40bb-8352-26cf0f9e8035 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:23.389120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5dcf0e20-689e-40bb-8352-26cf0f9e8035 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:23.390212 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5dcf0e20-689e-40bb-8352-26cf0f9e8035 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:23.391217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5dcf0e20-689e-40bb-8352-26cf0f9e8035 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:23.669504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0f5fa121-d759-4372-8bdb-7adb433b7a82 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:23.679702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0f5fa121-d759-4372-8bdb-7adb433b7a82 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 0.359033 Dec 21 04:04:23.690765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 30/72] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:23 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:23.693763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f41278f5-655c-4e9c-a90d-dc5910afccbf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:23.694446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f41278f5-655c-4e9c-a90d-dc5910afccbf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:23.703384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f41278f5-655c-4e9c-a90d-dc5910afccbf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:23.703897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f41278f5-655c-4e9c-a90d-dc5910afccbf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:23.704765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f41278f5-655c-4e9c-a90d-dc5910afccbf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:23.705258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f41278f5-655c-4e9c-a90d-dc5910afccbf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:23.848372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f41278f5-655c-4e9c-a90d-dc5910afccbf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:23.857646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f41278f5-655c-4e9c-a90d-dc5910afccbf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1278 microversion: 2.1 time: 0.173674 Dec 21 04:04:23.858454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 31/73] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:23 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:24.026934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f5f36b72-d295-4051-8fed-eafc011b5563 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:24.028347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f5f36b72-d295-4051-8fed-eafc011b5563 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:24.036234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5f36b72-d295-4051-8fed-eafc011b5563 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:24.036731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5f36b72-d295-4051-8fed-eafc011b5563 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:24.038241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5f36b72-d295-4051-8fed-eafc011b5563 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:24.039002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5f36b72-d295-4051-8fed-eafc011b5563 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:24.185056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f5f36b72-d295-4051-8fed-eafc011b5563 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:24.196392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f5f36b72-d295-4051-8fed-eafc011b5563 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1296 microversion: 2.1 time: 0.178367 Dec 21 04:04:24.198298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 32/74] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:24 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1296 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:24.266303 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a34562c4-33a0-4856-aca3-0bd93791c81f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:24.267280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a34562c4-33a0-4856-aca3-0bd93791c81f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:24.277090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a34562c4-33a0-4856-aca3-0bd93791c81f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:24.277948 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a34562c4-33a0-4856-aca3-0bd93791c81f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:24.278988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a34562c4-33a0-4856-aca3-0bd93791c81f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:24.279661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a34562c4-33a0-4856-aca3-0bd93791c81f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:24.436336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5dcf0e20-689e-40bb-8352-26cf0f9e8035 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:24.440706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a34562c4-33a0-4856-aca3-0bd93791c81f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:24.471424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5dcf0e20-689e-40bb-8352-26cf0f9e8035 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 1.122969 Dec 21 04:04:24.487281 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 43/75] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:23 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:24.487475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a34562c4-33a0-4856-aca3-0bd93791c81f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:24.487475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a34562c4-33a0-4856-aca3-0bd93791c81f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:24.488315 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a34562c4-33a0-4856-aca3-0bd93791c81f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1340 microversion: 2.20 time: 0.232819 Dec 21 04:04:24.489127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 33/76] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:24 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1340 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:24.707832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-17981d8f-cc5b-4cf1-98f1-0c6f40a6ceba tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:24.708577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-17981d8f-cc5b-4cf1-98f1-0c6f40a6ceba tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:24.725539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-17981d8f-cc5b-4cf1-98f1-0c6f40a6ceba tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:24.729717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-17981d8f-cc5b-4cf1-98f1-0c6f40a6ceba tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:24.730683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-17981d8f-cc5b-4cf1-98f1-0c6f40a6ceba tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:24.731308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-17981d8f-cc5b-4cf1-98f1-0c6f40a6ceba tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:24.893719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bf61753c-b220-4986-acc9-02909080d98f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:24.894389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bf61753c-b220-4986-acc9-02909080d98f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:24.909151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf61753c-b220-4986-acc9-02909080d98f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:24.909658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf61753c-b220-4986-acc9-02909080d98f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:24.910496 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf61753c-b220-4986-acc9-02909080d98f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:24.911012 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf61753c-b220-4986-acc9-02909080d98f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:25.171798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bf61753c-b220-4986-acc9-02909080d98f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:25.181474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bf61753c-b220-4986-acc9-02909080d98f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.306342 Dec 21 04:04:25.182111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 34/77] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:24 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:25.221438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ce81e2cb-8ea4-4bc7-ab9a-f5f4aa0022c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:25.222212 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ce81e2cb-8ea4-4bc7-ab9a-f5f4aa0022c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:25.231316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ce81e2cb-8ea4-4bc7-ab9a-f5f4aa0022c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:25.231919 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ce81e2cb-8ea4-4bc7-ab9a-f5f4aa0022c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:25.232645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ce81e2cb-8ea4-4bc7-ab9a-f5f4aa0022c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:25.233135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ce81e2cb-8ea4-4bc7-ab9a-f5f4aa0022c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:25.548014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ce81e2cb-8ea4-4bc7-ab9a-f5f4aa0022c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:25.559332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ce81e2cb-8ea4-4bc7-ab9a-f5f4aa0022c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.346843 Dec 21 04:04:25.559899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 35/78] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:25 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:25.587779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4d37f182-97eb-4757-b0c8-f3f41c59e2ae tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:25.588750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4d37f182-97eb-4757-b0c8-f3f41c59e2ae tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:25.599816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d37f182-97eb-4757-b0c8-f3f41c59e2ae tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:25.600623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d37f182-97eb-4757-b0c8-f3f41c59e2ae tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:25.601721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d37f182-97eb-4757-b0c8-f3f41c59e2ae tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:25.603265 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d37f182-97eb-4757-b0c8-f3f41c59e2ae tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:25.966877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4d37f182-97eb-4757-b0c8-f3f41c59e2ae tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:25.986803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4d37f182-97eb-4757-b0c8-f3f41c59e2ae tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 0.419565 Dec 21 04:04:25.988034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 36/79] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:25 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:26.014710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-62e5a1fc-5377-4bfb-b772-76d38b93a6d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:26.019667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-62e5a1fc-5377-4bfb-b772-76d38b93a6d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:26.032680 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62e5a1fc-5377-4bfb-b772-76d38b93a6d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:26.039651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62e5a1fc-5377-4bfb-b772-76d38b93a6d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:26.047672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62e5a1fc-5377-4bfb-b772-76d38b93a6d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:26.048271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62e5a1fc-5377-4bfb-b772-76d38b93a6d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:26.220518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-17981d8f-cc5b-4cf1-98f1-0c6f40a6ceba tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:26.235774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-17981d8f-cc5b-4cf1-98f1-0c6f40a6ceba tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 1.541831 Dec 21 04:04:26.236383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 44/80] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:24 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:26.384400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-26cda24e-d0cf-4813-8b83-0ea8a83e685d req-c1882bc3-f4c3-4e66-b8a0-f24ba97ccc18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7310cf50-d008-4e86-94b0-9a1a0e0c8fad", "name": "network-vif-plugged", "status": "completed", "tag": "e659557b-9fe0-4ca8-b96e-86df08ff2db2"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:26.401017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-62e5a1fc-5377-4bfb-b772-76d38b93a6d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:26.403703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:26.403703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:26.421368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-26cda24e-d0cf-4813-8b83-0ea8a83e685d req-c1882bc3-f4c3-4e66-b8a0-f24ba97ccc18 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:26.422145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-26cda24e-d0cf-4813-8b83-0ea8a83e685d req-c1882bc3-f4c3-4e66-b8a0-f24ba97ccc18 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:26.439483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-62e5a1fc-5377-4bfb-b772-76d38b93a6d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:26.446745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-26cda24e-d0cf-4813-8b83-0ea8a83e685d req-c1882bc3-f4c3-4e66-b8a0-f24ba97ccc18 service nova] Creating event network-vif-plugged:e659557b-9fe0-4ca8-b96e-86df08ff2db2 for instance 7310cf50-d008-4e86-94b0-9a1a0e0c8fad on hv-cinder-73306 Dec 21 04:04:26.450384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-62e5a1fc-5377-4bfb-b772-76d38b93a6d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:26.453074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-26cda24e-d0cf-4813-8b83-0ea8a83e685d req-c1882bc3-f4c3-4e66-b8a0-f24ba97ccc18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215315 Dec 21 04:04:26.454127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 45/81] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:26 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:26.456516 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-62e5a1fc-5377-4bfb-b772-76d38b93a6d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.456622 Dec 21 04:04:26.458246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 37/82] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:25 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:26.483003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e41e5d63-28c4-48b7-94bc-7d0da9c06a2a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:26.488093 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e41e5d63-28c4-48b7-94bc-7d0da9c06a2a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:26.503007 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e41e5d63-28c4-48b7-94bc-7d0da9c06a2a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:26.504060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e41e5d63-28c4-48b7-94bc-7d0da9c06a2a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:26.505263 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e41e5d63-28c4-48b7-94bc-7d0da9c06a2a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:26.505935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e41e5d63-28c4-48b7-94bc-7d0da9c06a2a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:26.586819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2fcf1c1f-38f7-4342-bea7-97eb79bcad96 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:26.587523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2fcf1c1f-38f7-4342-bea7-97eb79bcad96 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:26.606364 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2fcf1c1f-38f7-4342-bea7-97eb79bcad96 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:26.607166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2fcf1c1f-38f7-4342-bea7-97eb79bcad96 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:26.608018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2fcf1c1f-38f7-4342-bea7-97eb79bcad96 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:26.608507 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2fcf1c1f-38f7-4342-bea7-97eb79bcad96 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:26.990287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2fcf1c1f-38f7-4342-bea7-97eb79bcad96 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:27.010549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2fcf1c1f-38f7-4342-bea7-97eb79bcad96 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.434458 Dec 21 04:04:27.013540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 38/83] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:26 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:27.040531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7b660735-5c1f-4f57-b431-9111e7513865 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:27.042265 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7b660735-5c1f-4f57-b431-9111e7513865 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:27.059652 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b660735-5c1f-4f57-b431-9111e7513865 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:27.060162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b660735-5c1f-4f57-b431-9111e7513865 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:27.061008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b660735-5c1f-4f57-b431-9111e7513865 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:27.061495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b660735-5c1f-4f57-b431-9111e7513865 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:27.396994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7b660735-5c1f-4f57-b431-9111e7513865 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:27.409350 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7b660735-5c1f-4f57-b431-9111e7513865 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 0.381484 Dec 21 04:04:27.410102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 39/84] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:27 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:27.420058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-64e2f623-f8ae-44b8-8387-2276c7e101b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:27.420917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-64e2f623-f8ae-44b8-8387-2276c7e101b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:27.428862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-64e2f623-f8ae-44b8-8387-2276c7e101b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:27.429567 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-64e2f623-f8ae-44b8-8387-2276c7e101b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:27.430846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-64e2f623-f8ae-44b8-8387-2276c7e101b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:27.431504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-64e2f623-f8ae-44b8-8387-2276c7e101b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:27.691437 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-64e2f623-f8ae-44b8-8387-2276c7e101b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:27.701416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-64e2f623-f8ae-44b8-8387-2276c7e101b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 0.290104 Dec 21 04:04:27.702088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 40/85] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:27 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:27.712738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e70bf959-fe1d-44ce-a236-30128190414c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:27.713482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e70bf959-fe1d-44ce-a236-30128190414c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:27.721942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e70bf959-fe1d-44ce-a236-30128190414c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:27.722525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e70bf959-fe1d-44ce-a236-30128190414c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:27.723640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e70bf959-fe1d-44ce-a236-30128190414c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:27.724207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e70bf959-fe1d-44ce-a236-30128190414c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:27.964900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e70bf959-fe1d-44ce-a236-30128190414c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:27.981085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e70bf959-fe1d-44ce-a236-30128190414c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:27.988186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e70bf959-fe1d-44ce-a236-30128190414c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:27.989468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e70bf959-fe1d-44ce-a236-30128190414c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.286174 Dec 21 04:04:27.990060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 41/86] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:27 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:28.035840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-400c6287-1f46-4a25-b369-6a1fa4acca15 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:28.036517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-400c6287-1f46-4a25-b369-6a1fa4acca15 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:28.045003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-400c6287-1f46-4a25-b369-6a1fa4acca15 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:28.045514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-400c6287-1f46-4a25-b369-6a1fa4acca15 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:28.046345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-400c6287-1f46-4a25-b369-6a1fa4acca15 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:28.047192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-400c6287-1f46-4a25-b369-6a1fa4acca15 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:28.204359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e41e5d63-28c4-48b7-94bc-7d0da9c06a2a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:28.225642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e41e5d63-28c4-48b7-94bc-7d0da9c06a2a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 1.767097 Dec 21 04:04:28.226248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 46/87] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:26 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:28.345418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-400c6287-1f46-4a25-b369-6a1fa4acca15 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:28.356564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-400c6287-1f46-4a25-b369-6a1fa4acca15 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.329786 Dec 21 04:04:28.357172 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 42/88] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:28 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:28.434869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-09239225-f647-4e1c-8bd3-bc1dc3f9b886 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:28.436111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-09239225-f647-4e1c-8bd3-bc1dc3f9b886 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:28.461064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09239225-f647-4e1c-8bd3-bc1dc3f9b886 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:28.463825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09239225-f647-4e1c-8bd3-bc1dc3f9b886 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:28.464924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09239225-f647-4e1c-8bd3-bc1dc3f9b886 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:28.467730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09239225-f647-4e1c-8bd3-bc1dc3f9b886 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:28.518781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-c9c1ea35-7fba-4d97-ac02-f0970970f164 req-2e434073-816c-4f9b-aeda-47d538a82bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658a086f-4f18-4fe0-a27b-c88bdf8bba38", "name": "network-vif-plugged", "status": "completed", "tag": "c3d06276-942a-422b-add5-5fb80a8c96cc"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:28.534684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:28.534684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:28.547800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-c9c1ea35-7fba-4d97-ac02-f0970970f164 req-2e434073-816c-4f9b-aeda-47d538a82bfa service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:28.548523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-c9c1ea35-7fba-4d97-ac02-f0970970f164 req-2e434073-816c-4f9b-aeda-47d538a82bfa service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:28.568965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-c9c1ea35-7fba-4d97-ac02-f0970970f164 req-2e434073-816c-4f9b-aeda-47d538a82bfa service nova] Creating event network-vif-plugged:c3d06276-942a-422b-add5-5fb80a8c96cc for instance 658a086f-4f18-4fe0-a27b-c88bdf8bba38 on hv-cinder-73306 Dec 21 04:04:28.583687 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-c9c1ea35-7fba-4d97-ac02-f0970970f164 req-2e434073-816c-4f9b-aeda-47d538a82bfa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079738 Dec 21 04:04:28.585441 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 43/89] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:28 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:04:28.729271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4e573c7e-a8d6-430f-baa1-f8629e57f703 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:28.730752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4e573c7e-a8d6-430f-baa1-f8629e57f703 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:28.749576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e573c7e-a8d6-430f-baa1-f8629e57f703 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:28.750399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e573c7e-a8d6-430f-baa1-f8629e57f703 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:28.751624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e573c7e-a8d6-430f-baa1-f8629e57f703 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:28.755665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e573c7e-a8d6-430f-baa1-f8629e57f703 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:29.396315 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4e573c7e-a8d6-430f-baa1-f8629e57f703 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:29.405365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4e573c7e-a8d6-430f-baa1-f8629e57f703 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 0.689255 Dec 21 04:04:29.405954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 44/90] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:28 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:29.415624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ce88af26-0431-44db-a03e-e6da8ef42b35 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:29.416276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ce88af26-0431-44db-a03e-e6da8ef42b35 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:29.424155 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ce88af26-0431-44db-a03e-e6da8ef42b35 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:29.424318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ce88af26-0431-44db-a03e-e6da8ef42b35 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:29.425115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ce88af26-0431-44db-a03e-e6da8ef42b35 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:29.425602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ce88af26-0431-44db-a03e-e6da8ef42b35 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:29.648748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ce88af26-0431-44db-a03e-e6da8ef42b35 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:29.665317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ce88af26-0431-44db-a03e-e6da8ef42b35 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:29.672014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ce88af26-0431-44db-a03e-e6da8ef42b35 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:29.673185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ce88af26-0431-44db-a03e-e6da8ef42b35 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.266244 Dec 21 04:04:29.673776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 45/91] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:29 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:29.684180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ae02e324-5483-4026-8ade-aa0087912179 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:29.685022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ae02e324-5483-4026-8ade-aa0087912179 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:29.685545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-09239225-f647-4e1c-8bd3-bc1dc3f9b886 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:29.693336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae02e324-5483-4026-8ade-aa0087912179 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:29.694320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae02e324-5483-4026-8ade-aa0087912179 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:29.695577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae02e324-5483-4026-8ade-aa0087912179 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:29.696323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae02e324-5483-4026-8ade-aa0087912179 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:29.700032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-09239225-f647-4e1c-8bd3-bc1dc3f9b886 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1315 microversion: 2.1 time: 1.276105 Dec 21 04:04:29.700784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 47/92] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:28 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1315 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:29.716179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b7ea780b-62f2-4307-ae17-a810247373a6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:29.717286 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b7ea780b-62f2-4307-ae17-a810247373a6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:29.725810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7ea780b-62f2-4307-ae17-a810247373a6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:29.727209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7ea780b-62f2-4307-ae17-a810247373a6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:29.728494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7ea780b-62f2-4307-ae17-a810247373a6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:29.729618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7ea780b-62f2-4307-ae17-a810247373a6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:29.985945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ae02e324-5483-4026-8ade-aa0087912179 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:29.996857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ae02e324-5483-4026-8ade-aa0087912179 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.321913 Dec 21 04:04:29.997475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 46/93] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:29 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:30.428751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b456cfb9-f4a2-478e-8188-4434c7f9b029 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:30.430204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b456cfb9-f4a2-478e-8188-4434c7f9b029 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:30.438388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b456cfb9-f4a2-478e-8188-4434c7f9b029 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:30.439014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b456cfb9-f4a2-478e-8188-4434c7f9b029 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:30.440085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b456cfb9-f4a2-478e-8188-4434c7f9b029 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:30.440672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b456cfb9-f4a2-478e-8188-4434c7f9b029 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:30.780485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b456cfb9-f4a2-478e-8188-4434c7f9b029 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:30.790389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b456cfb9-f4a2-478e-8188-4434c7f9b029 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 0.371123 Dec 21 04:04:30.791454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 47/94] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:30 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:30.803870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-44d9239c-ee7e-47a0-9ab5-3e2ea30f5662 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:30.804656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-44d9239c-ee7e-47a0-9ab5-3e2ea30f5662 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:30.812649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44d9239c-ee7e-47a0-9ab5-3e2ea30f5662 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:30.813410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44d9239c-ee7e-47a0-9ab5-3e2ea30f5662 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:30.814479 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44d9239c-ee7e-47a0-9ab5-3e2ea30f5662 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:30.815156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44d9239c-ee7e-47a0-9ab5-3e2ea30f5662 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:31.041676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-44d9239c-ee7e-47a0-9ab5-3e2ea30f5662 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:31.057136 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-44d9239c-ee7e-47a0-9ab5-3e2ea30f5662 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:31.063773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-44d9239c-ee7e-47a0-9ab5-3e2ea30f5662 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:31.064917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-44d9239c-ee7e-47a0-9ab5-3e2ea30f5662 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.272104 Dec 21 04:04:31.065555 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 48/95] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:30 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:31.085802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-99182d65-8ef8-465c-8f92-7c8cc6e92de8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:31.086652 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-99182d65-8ef8-465c-8f92-7c8cc6e92de8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:31.094486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-99182d65-8ef8-465c-8f92-7c8cc6e92de8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:31.095049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-99182d65-8ef8-465c-8f92-7c8cc6e92de8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:31.095885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-99182d65-8ef8-465c-8f92-7c8cc6e92de8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:31.096382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-99182d65-8ef8-465c-8f92-7c8cc6e92de8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:31.155042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b7ea780b-62f2-4307-ae17-a810247373a6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:31.165990 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b7ea780b-62f2-4307-ae17-a810247373a6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 1.463876 Dec 21 04:04:31.166737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 48/96] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:29 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:31.279993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-d749d279-fef9-47e5-ad20-0bf3553ce408 req-65e04a71-ade1-4d76-b6aa-1ece12b7964c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066ef53e-6421-4004-bd12-2e238a638cd1", "tag": "3f4c4622-8f1b-42c5-bfc5-c5e155218d89"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:31.286825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:31.286825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:31.296520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-d749d279-fef9-47e5-ad20-0bf3553ce408 req-65e04a71-ade1-4d76-b6aa-1ece12b7964c service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:31.297030 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-d749d279-fef9-47e5-ad20-0bf3553ce408 req-65e04a71-ade1-4d76-b6aa-1ece12b7964c service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:31.315425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-d749d279-fef9-47e5-ad20-0bf3553ce408 req-65e04a71-ade1-4d76-b6aa-1ece12b7964c service nova] Creating event network-changed:3f4c4622-8f1b-42c5-bfc5-c5e155218d89 for instance 066ef53e-6421-4004-bd12-2e238a638cd1 on hv-cinder-73306 Dec 21 04:04:31.321747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-d749d279-fef9-47e5-ad20-0bf3553ce408 req-65e04a71-ade1-4d76-b6aa-1ece12b7964c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153464 Dec 21 04:04:31.322570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 49/97] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:31 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:31.324945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-99182d65-8ef8-465c-8f92-7c8cc6e92de8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:31.333901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e551a55b-b7c0-475e-a5f1-a3a62cb45edc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:31.334413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-99182d65-8ef8-465c-8f92-7c8cc6e92de8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1503 microversion: 2.1 time: 0.257138 Dec 21 04:04:31.334670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e551a55b-b7c0-475e-a5f1-a3a62cb45edc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:31.335409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 49/98] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:31 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:31.343699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e551a55b-b7c0-475e-a5f1-a3a62cb45edc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:31.344321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e551a55b-b7c0-475e-a5f1-a3a62cb45edc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:31.345270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e551a55b-b7c0-475e-a5f1-a3a62cb45edc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:31.345869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e551a55b-b7c0-475e-a5f1-a3a62cb45edc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:31.825202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0476f6c7-1381-42ff-87f5-c29be131180f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:31.825892 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0476f6c7-1381-42ff-87f5-c29be131180f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:31.855024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0476f6c7-1381-42ff-87f5-c29be131180f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:31.855493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0476f6c7-1381-42ff-87f5-c29be131180f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:31.856350 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0476f6c7-1381-42ff-87f5-c29be131180f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:31.856846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0476f6c7-1381-42ff-87f5-c29be131180f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:31.925415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e551a55b-b7c0-475e-a5f1-a3a62cb45edc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:31.941812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e551a55b-b7c0-475e-a5f1-a3a62cb45edc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.618104 Dec 21 04:04:31.949552 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 50/99] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:31 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:32.089241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2df2b953-b57d-4dcd-a591-ba19b0491b4f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:32.094761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2df2b953-b57d-4dcd-a591-ba19b0491b4f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:32.126827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2df2b953-b57d-4dcd-a591-ba19b0491b4f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:32.127672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2df2b953-b57d-4dcd-a591-ba19b0491b4f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:32.128718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2df2b953-b57d-4dcd-a591-ba19b0491b4f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:32.131664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2df2b953-b57d-4dcd-a591-ba19b0491b4f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:32.339585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0476f6c7-1381-42ff-87f5-c29be131180f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:32.349321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0476f6c7-1381-42ff-87f5-c29be131180f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1318 microversion: 2.1 time: 0.545058 Dec 21 04:04:32.349882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 50/100] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:31 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:32.361835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-412fcd47-8dd6-4a9d-9861-1a32c9a71b2c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:32.362800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-412fcd47-8dd6-4a9d-9861-1a32c9a71b2c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:32.371614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-412fcd47-8dd6-4a9d-9861-1a32c9a71b2c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:32.372094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-412fcd47-8dd6-4a9d-9861-1a32c9a71b2c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:32.373111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-412fcd47-8dd6-4a9d-9861-1a32c9a71b2c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:32.373739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-412fcd47-8dd6-4a9d-9861-1a32c9a71b2c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:32.787287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-412fcd47-8dd6-4a9d-9861-1a32c9a71b2c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:32.796184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-412fcd47-8dd6-4a9d-9861-1a32c9a71b2c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.445039 Dec 21 04:04:32.796786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 51/101] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:32 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:32.975324 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ee2e4997-9932-4536-bb4e-4c45bfb69b4a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:32.976863 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ee2e4997-9932-4536-bb4e-4c45bfb69b4a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:32.995536 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee2e4997-9932-4536-bb4e-4c45bfb69b4a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:32.996085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee2e4997-9932-4536-bb4e-4c45bfb69b4a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:32.996932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee2e4997-9932-4536-bb4e-4c45bfb69b4a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:32.997423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee2e4997-9932-4536-bb4e-4c45bfb69b4a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:33.300234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ee2e4997-9932-4536-bb4e-4c45bfb69b4a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:33.314007 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ee2e4997-9932-4536-bb4e-4c45bfb69b4a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.351658 Dec 21 04:04:33.314607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 52/102] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:32 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:33.377943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fee103af-07da-4cad-8f61-73ddaf3abb09 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:33.380311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fee103af-07da-4cad-8f61-73ddaf3abb09 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:33.410405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fee103af-07da-4cad-8f61-73ddaf3abb09 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:33.411727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fee103af-07da-4cad-8f61-73ddaf3abb09 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:33.414559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fee103af-07da-4cad-8f61-73ddaf3abb09 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:33.416488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fee103af-07da-4cad-8f61-73ddaf3abb09 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:33.627170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2df2b953-b57d-4dcd-a591-ba19b0491b4f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:33.653897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2df2b953-b57d-4dcd-a591-ba19b0491b4f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:33.671113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2df2b953-b57d-4dcd-a591-ba19b0491b4f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:33.672270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2df2b953-b57d-4dcd-a591-ba19b0491b4f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 1.592795 Dec 21 04:04:33.683681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 51/103] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:32 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:33.703638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cfa58ede-7e3f-4cec-b839-7bfc2fa106e8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ea329db-95c0-41ca-8b54-12a191d146ef"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:33.705082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cfa58ede-7e3f-4cec-b839-7bfc2fa106e8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:33.723211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cfa58ede-7e3f-4cec-b839-7bfc2fa106e8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:33.723693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cfa58ede-7e3f-4cec-b839-7bfc2fa106e8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:33.724717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cfa58ede-7e3f-4cec-b839-7bfc2fa106e8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:33.725351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cfa58ede-7e3f-4cec-b839-7bfc2fa106e8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:33.812065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fee103af-07da-4cad-8f61-73ddaf3abb09 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:33.838481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fee103af-07da-4cad-8f61-73ddaf3abb09 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1508 microversion: 2.1 time: 0.474904 Dec 21 04:04:33.842558 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 53/104] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:33 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1508 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:33.871494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-6eabfe1a-4e03-4eb0-8192-2c4df6fd8aa9 req-069ae3e8-99a7-4206-8276-dd0529db465d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c", "tag": "f383262c-f81f-4b3d-a438-e84aba847b2b"}, {"name": "network-changed", "server_uuid": "37226a3f-240e-4e04-9813-fa3d109452de", "tag": "cebf23f8-0aba-463b-89c6-d9e38a717d77"}, {"name": "network-changed", "server_uuid": "de36eb65-105b-41ce-b7fe-04a39c08724a", "tag": "112992d5-34d2-4969-bb40-152ef22b2f72"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:33.879068 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:33.879068 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:33.904879 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-6eabfe1a-4e03-4eb0-8192-2c4df6fd8aa9 req-069ae3e8-99a7-4206-8276-dd0529db465d service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:33.909430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-6eabfe1a-4e03-4eb0-8192-2c4df6fd8aa9 req-069ae3e8-99a7-4206-8276-dd0529db465d service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:33.955955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-6eabfe1a-4e03-4eb0-8192-2c4df6fd8aa9 req-069ae3e8-99a7-4206-8276-dd0529db465d service nova] Creating event network-changed:f383262c-f81f-4b3d-a438-e84aba847b2b for instance 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c on hv-cinder-73306 Dec 21 04:04:33.956549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-6eabfe1a-4e03-4eb0-8192-2c4df6fd8aa9 req-069ae3e8-99a7-4206-8276-dd0529db465d service nova] Creating event network-changed:cebf23f8-0aba-463b-89c6-d9e38a717d77 for instance 37226a3f-240e-4e04-9813-fa3d109452de on hv-cinder-73306 Dec 21 04:04:33.958544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-6eabfe1a-4e03-4eb0-8192-2c4df6fd8aa9 req-069ae3e8-99a7-4206-8276-dd0529db465d service nova] Creating event network-changed:112992d5-34d2-4969-bb40-152ef22b2f72 for instance de36eb65-105b-41ce-b7fe-04a39c08724a on hv-cinder-73306 Dec 21 04:04:33.978704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-6eabfe1a-4e03-4eb0-8192-2c4df6fd8aa9 req-069ae3e8-99a7-4206-8276-dd0529db465d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.134811 Dec 21 04:04:33.979417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 54/105] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:33 2020] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:34.010300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cbf16417-11b6-4a78-b682-6481212d4eca tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:34.011192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cbf16417-11b6-4a78-b682-6481212d4eca tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:34.052258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbf16417-11b6-4a78-b682-6481212d4eca tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:34.056356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbf16417-11b6-4a78-b682-6481212d4eca tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:34.058329 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbf16417-11b6-4a78-b682-6481212d4eca tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:34.059665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbf16417-11b6-4a78-b682-6481212d4eca tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:34.575987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cfa58ede-7e3f-4cec-b839-7bfc2fa106e8 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "POST /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.890639 Dec 21 04:04:34.577793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 52/106] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Dec 21 04:04:33 2020] POST /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:34.609923 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cbf16417-11b6-4a78-b682-6481212d4eca tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:34.614214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fe5e5910-2305-471f-9bdd-1f7f39815faf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:34.615134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fe5e5910-2305-471f-9bdd-1f7f39815faf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:34.624987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe5e5910-2305-471f-9bdd-1f7f39815faf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:34.626470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe5e5910-2305-471f-9bdd-1f7f39815faf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:34.627418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe5e5910-2305-471f-9bdd-1f7f39815faf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:34.628090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe5e5910-2305-471f-9bdd-1f7f39815faf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:34.632771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cbf16417-11b6-4a78-b682-6481212d4eca tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.649077 Dec 21 04:04:34.633253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 55/107] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:33 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:34.712636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-343cf54d-0e0e-440c-896e-39f13b69d675 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:34.713311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-343cf54d-0e0e-440c-896e-39f13b69d675 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:34.740620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-343cf54d-0e0e-440c-896e-39f13b69d675 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:34.741137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-343cf54d-0e0e-440c-896e-39f13b69d675 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:34.742592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-343cf54d-0e0e-440c-896e-39f13b69d675 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:34.743052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-343cf54d-0e0e-440c-896e-39f13b69d675 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:35.442311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-343cf54d-0e0e-440c-896e-39f13b69d675 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:35.478759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-343cf54d-0e0e-440c-896e-39f13b69d675 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:35.486179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-343cf54d-0e0e-440c-896e-39f13b69d675 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:35.488103 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-343cf54d-0e0e-440c-896e-39f13b69d675 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.789722 Dec 21 04:04:35.488909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 56/108] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:34 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:35.655556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-943f1ecf-2963-4b25-84ee-0aa6eb46d618 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:35.658599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-943f1ecf-2963-4b25-84ee-0aa6eb46d618 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:35.672704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-943f1ecf-2963-4b25-84ee-0aa6eb46d618 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:35.673327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-943f1ecf-2963-4b25-84ee-0aa6eb46d618 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:35.674269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-943f1ecf-2963-4b25-84ee-0aa6eb46d618 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:35.674866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-943f1ecf-2963-4b25-84ee-0aa6eb46d618 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:35.766960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fe5e5910-2305-471f-9bdd-1f7f39815faf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:35.781693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fe5e5910-2305-471f-9bdd-1f7f39815faf tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 1.198714 Dec 21 04:04:35.782410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 53/109] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:34 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:35.920135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-943f1ecf-2963-4b25-84ee-0aa6eb46d618 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:35.929300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-943f1ecf-2963-4b25-84ee-0aa6eb46d618 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.283548 Dec 21 04:04:35.930472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 57/110] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:35 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:36.187495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6ac72711-f1df-4054-a12e-58f893c53354 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72dc57a3-ae6e-4e99-959b-7bfeb3314c0f"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:36.188875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6ac72711-f1df-4054-a12e-58f893c53354 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:36.201606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ac72711-f1df-4054-a12e-58f893c53354 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:36.202289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ac72711-f1df-4054-a12e-58f893c53354 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:36.204336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ac72711-f1df-4054-a12e-58f893c53354 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:36.204833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ac72711-f1df-4054-a12e-58f893c53354 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:36.523849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-df657129-a98a-4354-bae5-bc9d02b2ef00 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:36.525899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-df657129-a98a-4354-bae5-bc9d02b2ef00 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:36.549460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df657129-a98a-4354-bae5-bc9d02b2ef00 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:36.549962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df657129-a98a-4354-bae5-bc9d02b2ef00 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:36.551024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df657129-a98a-4354-bae5-bc9d02b2ef00 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:36.553892 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df657129-a98a-4354-bae5-bc9d02b2ef00 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:36.893465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6ac72711-f1df-4054-a12e-58f893c53354 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "POST /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.715770 Dec 21 04:04:36.894459 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 54/111] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Dec 21 04:04:36 2020] POST /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38/os-volume_attachments => generated 194 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:36.908342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-44dd0364-e1b5-4d72-987d-293d870573a8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:36.909464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-44dd0364-e1b5-4d72-987d-293d870573a8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:36.921280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44dd0364-e1b5-4d72-987d-293d870573a8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:36.922121 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44dd0364-e1b5-4d72-987d-293d870573a8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:36.923232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44dd0364-e1b5-4d72-987d-293d870573a8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:36.923925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44dd0364-e1b5-4d72-987d-293d870573a8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:36.995500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-df657129-a98a-4354-bae5-bc9d02b2ef00 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:37.028302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-df657129-a98a-4354-bae5-bc9d02b2ef00 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:37.036853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-df657129-a98a-4354-bae5-bc9d02b2ef00 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:37.038445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-df657129-a98a-4354-bae5-bc9d02b2ef00 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.533999 Dec 21 04:04:37.039531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 58/112] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:36 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:37.080101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a0b30720-1def-48a6-8703-c476cfd9dab7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:37.081473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a0b30720-1def-48a6-8703-c476cfd9dab7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:37.113014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0b30720-1def-48a6-8703-c476cfd9dab7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:37.113516 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0b30720-1def-48a6-8703-c476cfd9dab7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:37.119120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0b30720-1def-48a6-8703-c476cfd9dab7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:37.119640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0b30720-1def-48a6-8703-c476cfd9dab7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:37.349494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-44dd0364-e1b5-4d72-987d-293d870573a8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:37.359355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-44dd0364-e1b5-4d72-987d-293d870573a8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.463316 Dec 21 04:04:37.360000 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 55/113] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:36 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:37.524516 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a0b30720-1def-48a6-8703-c476cfd9dab7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:37.533566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a0b30720-1def-48a6-8703-c476cfd9dab7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.492147 Dec 21 04:04:37.534248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 59/114] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:37 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:38.063106 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dbed5f8c-cf7f-4d9c-87cf-5fc45a873e81 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:38.063774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dbed5f8c-cf7f-4d9c-87cf-5fc45a873e81 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:38.072670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dbed5f8c-cf7f-4d9c-87cf-5fc45a873e81 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:38.073174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dbed5f8c-cf7f-4d9c-87cf-5fc45a873e81 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:38.074007 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dbed5f8c-cf7f-4d9c-87cf-5fc45a873e81 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:38.074500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dbed5f8c-cf7f-4d9c-87cf-5fc45a873e81 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:38.314711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dbed5f8c-cf7f-4d9c-87cf-5fc45a873e81 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:38.331712 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dbed5f8c-cf7f-4d9c-87cf-5fc45a873e81 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:38.339730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dbed5f8c-cf7f-4d9c-87cf-5fc45a873e81 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:38.341118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dbed5f8c-cf7f-4d9c-87cf-5fc45a873e81 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.287928 Dec 21 04:04:38.342660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 56/115] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:38 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:38.383101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-264c7579-0244-4895-a117-e39ab00a466d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:38.383855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-264c7579-0244-4895-a117-e39ab00a466d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:38.391832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-264c7579-0244-4895-a117-e39ab00a466d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:38.392363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-264c7579-0244-4895-a117-e39ab00a466d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:38.393191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-264c7579-0244-4895-a117-e39ab00a466d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:38.393680 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-264c7579-0244-4895-a117-e39ab00a466d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:38.558473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-25a6b6d7-dad7-4f3d-9638-d87d43f73e9c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:38.559832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-25a6b6d7-dad7-4f3d-9638-d87d43f73e9c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:38.568239 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-25a6b6d7-dad7-4f3d-9638-d87d43f73e9c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:38.568754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-25a6b6d7-dad7-4f3d-9638-d87d43f73e9c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:38.569580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-25a6b6d7-dad7-4f3d-9638-d87d43f73e9c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:38.570353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-25a6b6d7-dad7-4f3d-9638-d87d43f73e9c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:38.626803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-264c7579-0244-4895-a117-e39ab00a466d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:38.638124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-264c7579-0244-4895-a117-e39ab00a466d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.264281 Dec 21 04:04:38.638828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 60/116] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:38 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:38.803096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-25a6b6d7-dad7-4f3d-9638-d87d43f73e9c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:38.817212 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-25a6b6d7-dad7-4f3d-9638-d87d43f73e9c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.268312 Dec 21 04:04:38.817615 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 57/117] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:38 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:39.371890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-82471149-9f19-4a4f-a2f9-4592885071c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:39.372544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-82471149-9f19-4a4f-a2f9-4592885071c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:39.382328 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-82471149-9f19-4a4f-a2f9-4592885071c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:39.383428 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-82471149-9f19-4a4f-a2f9-4592885071c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:39.384277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-82471149-9f19-4a4f-a2f9-4592885071c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:39.384767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-82471149-9f19-4a4f-a2f9-4592885071c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:39.619432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-82471149-9f19-4a4f-a2f9-4592885071c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:39.633738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-82471149-9f19-4a4f-a2f9-4592885071c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:39.640298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-82471149-9f19-4a4f-a2f9-4592885071c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:39.641422 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-82471149-9f19-4a4f-a2f9-4592885071c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.281529 Dec 21 04:04:39.642012 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 61/118] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:39 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:39.660909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a47b6df6-a785-42bf-a7b7-13b5677c6947 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:39.661666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a47b6df6-a785-42bf-a7b7-13b5677c6947 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:39.670158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a47b6df6-a785-42bf-a7b7-13b5677c6947 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:39.670672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a47b6df6-a785-42bf-a7b7-13b5677c6947 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:39.671594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a47b6df6-a785-42bf-a7b7-13b5677c6947 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:39.672141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a47b6df6-a785-42bf-a7b7-13b5677c6947 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:39.841618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b473ee8f-19b9-4672-9f4c-736727aafd6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:39.842303 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b473ee8f-19b9-4672-9f4c-736727aafd6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:39.850670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b473ee8f-19b9-4672-9f4c-736727aafd6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:39.851295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b473ee8f-19b9-4672-9f4c-736727aafd6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:39.852153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b473ee8f-19b9-4672-9f4c-736727aafd6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:39.853012 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b473ee8f-19b9-4672-9f4c-736727aafd6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:40.096120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b473ee8f-19b9-4672-9f4c-736727aafd6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:40.106433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b473ee8f-19b9-4672-9f4c-736727aafd6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.274959 Dec 21 04:04:40.107071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 62/119] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:39 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:40.120762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a47b6df6-a785-42bf-a7b7-13b5677c6947 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:40.129722 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a47b6df6-a785-42bf-a7b7-13b5677c6947 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.477693 Dec 21 04:04:40.130300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 58/120] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:39 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:40.667487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c33416a6-d007-4b71-9d9c-cf0532ed3079 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:40.668157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c33416a6-d007-4b71-9d9c-cf0532ed3079 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:40.690647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c33416a6-d007-4b71-9d9c-cf0532ed3079 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:40.691184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c33416a6-d007-4b71-9d9c-cf0532ed3079 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:40.692041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c33416a6-d007-4b71-9d9c-cf0532ed3079 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:40.692531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c33416a6-d007-4b71-9d9c-cf0532ed3079 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:40.996267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c33416a6-d007-4b71-9d9c-cf0532ed3079 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:41.013552 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c33416a6-d007-4b71-9d9c-cf0532ed3079 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:41.022504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c33416a6-d007-4b71-9d9c-cf0532ed3079 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:41.024618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c33416a6-d007-4b71-9d9c-cf0532ed3079 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.367492 Dec 21 04:04:41.027497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 63/121] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:40 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:41.133614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-952e4f73-93f9-40c3-bc40-a14f39809651 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:41.134258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-952e4f73-93f9-40c3-bc40-a14f39809651 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:41.143857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-952e4f73-93f9-40c3-bc40-a14f39809651 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:41.144754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-952e4f73-93f9-40c3-bc40-a14f39809651 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:41.146110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-952e4f73-93f9-40c3-bc40-a14f39809651 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:41.147122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-952e4f73-93f9-40c3-bc40-a14f39809651 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:41.152094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-94a45780-924c-40c2-aa3c-0725bd68bc95 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:41.152703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-94a45780-924c-40c2-aa3c-0725bd68bc95 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:41.175830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-94a45780-924c-40c2-aa3c-0725bd68bc95 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:41.176398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-94a45780-924c-40c2-aa3c-0725bd68bc95 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:41.177290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-94a45780-924c-40c2-aa3c-0725bd68bc95 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:41.177781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-94a45780-924c-40c2-aa3c-0725bd68bc95 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:41.495969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-94a45780-924c-40c2-aa3c-0725bd68bc95 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:41.508413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-94a45780-924c-40c2-aa3c-0725bd68bc95 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.365736 Dec 21 04:04:41.518374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 64/122] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:41 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:41.630625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-952e4f73-93f9-40c3-bc40-a14f39809651 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:41.643148 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-952e4f73-93f9-40c3-bc40-a14f39809651 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.521353 Dec 21 04:04:41.644404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 59/123] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:41 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:42.048607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5d3d5737-2020-4ce2-96d9-423d53a7772c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:42.049335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5d3d5737-2020-4ce2-96d9-423d53a7772c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:42.059908 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d3d5737-2020-4ce2-96d9-423d53a7772c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:42.060414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d3d5737-2020-4ce2-96d9-423d53a7772c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:42.061289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d3d5737-2020-4ce2-96d9-423d53a7772c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:42.061712 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d3d5737-2020-4ce2-96d9-423d53a7772c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:42.300438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5d3d5737-2020-4ce2-96d9-423d53a7772c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:42.316111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5d3d5737-2020-4ce2-96d9-423d53a7772c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:42.322780 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5d3d5737-2020-4ce2-96d9-423d53a7772c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:42.323962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5d3d5737-2020-4ce2-96d9-423d53a7772c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.284908 Dec 21 04:04:42.324521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 65/124] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:42 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:42.542805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-af836287-0a35-4da6-8619-f946c21efc16 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:42.543617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-af836287-0a35-4da6-8619-f946c21efc16 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:42.551719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af836287-0a35-4da6-8619-f946c21efc16 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:42.552225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af836287-0a35-4da6-8619-f946c21efc16 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:42.553060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af836287-0a35-4da6-8619-f946c21efc16 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:42.553548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af836287-0a35-4da6-8619-f946c21efc16 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:42.668202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-65de448d-fd58-4e32-9882-83870f797878 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:42.669088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-65de448d-fd58-4e32-9882-83870f797878 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:42.679872 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-65de448d-fd58-4e32-9882-83870f797878 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:42.680687 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-65de448d-fd58-4e32-9882-83870f797878 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:42.681830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-65de448d-fd58-4e32-9882-83870f797878 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:42.682438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-65de448d-fd58-4e32-9882-83870f797878 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:42.805513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-af836287-0a35-4da6-8619-f946c21efc16 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:42.815691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-af836287-0a35-4da6-8619-f946c21efc16 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.284688 Dec 21 04:04:42.817180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 60/125] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:42 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:43.028721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-65de448d-fd58-4e32-9882-83870f797878 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:43.037543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-65de448d-fd58-4e32-9882-83870f797878 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.379631 Dec 21 04:04:43.038295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 66/126] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:42 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:43.348778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-70581369-3d53-42e3-b047-cf868b4381da tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:43.350087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-70581369-3d53-42e3-b047-cf868b4381da tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:43.358878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70581369-3d53-42e3-b047-cf868b4381da tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:43.359721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70581369-3d53-42e3-b047-cf868b4381da tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:43.360724 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70581369-3d53-42e3-b047-cf868b4381da tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:43.361360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70581369-3d53-42e3-b047-cf868b4381da tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:43.704224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-70581369-3d53-42e3-b047-cf868b4381da tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:43.729326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-70581369-3d53-42e3-b047-cf868b4381da tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:43.737495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-70581369-3d53-42e3-b047-cf868b4381da tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:43.739007 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-70581369-3d53-42e3-b047-cf868b4381da tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.399661 Dec 21 04:04:43.740289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 61/127] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:43 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:43.841357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-11098bb1-761b-452c-a19a-ecd96f65b998 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:43.842022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-11098bb1-761b-452c-a19a-ecd96f65b998 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:43.850054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11098bb1-761b-452c-a19a-ecd96f65b998 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:43.850562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11098bb1-761b-452c-a19a-ecd96f65b998 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:43.851477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11098bb1-761b-452c-a19a-ecd96f65b998 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:43.851973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11098bb1-761b-452c-a19a-ecd96f65b998 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:44.062552 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-38dfc053-b692-4991-8b54-fe2161065c2b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:44.063392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-38dfc053-b692-4991-8b54-fe2161065c2b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:44.076801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-38dfc053-b692-4991-8b54-fe2161065c2b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:44.077316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-38dfc053-b692-4991-8b54-fe2161065c2b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:44.083057 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-38dfc053-b692-4991-8b54-fe2161065c2b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:44.083057 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-38dfc053-b692-4991-8b54-fe2161065c2b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:44.083209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-11098bb1-761b-452c-a19a-ecd96f65b998 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:44.092288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-11098bb1-761b-452c-a19a-ecd96f65b998 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.260550 Dec 21 04:04:44.102818 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 67/128] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:43 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:44.770366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-76be3689-a23f-4df9-9cb5-62fc1806337a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:44.772348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-76be3689-a23f-4df9-9cb5-62fc1806337a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:44.782987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76be3689-a23f-4df9-9cb5-62fc1806337a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:44.783789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76be3689-a23f-4df9-9cb5-62fc1806337a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:44.785464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76be3689-a23f-4df9-9cb5-62fc1806337a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:44.786162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76be3689-a23f-4df9-9cb5-62fc1806337a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:44.801098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-38dfc053-b692-4991-8b54-fe2161065c2b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:44.826354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-38dfc053-b692-4991-8b54-fe2161065c2b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.772131 Dec 21 04:04:44.827461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 62/129] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:44 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:45.115147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-21081128-eaae-4749-b941-ea7bcd6a1933 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:45.115808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-21081128-eaae-4749-b941-ea7bcd6a1933 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:45.139262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-21081128-eaae-4749-b941-ea7bcd6a1933 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:45.139768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-21081128-eaae-4749-b941-ea7bcd6a1933 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:45.140586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-21081128-eaae-4749-b941-ea7bcd6a1933 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:45.142872 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-21081128-eaae-4749-b941-ea7bcd6a1933 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:45.216993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-76be3689-a23f-4df9-9cb5-62fc1806337a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:45.266561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-76be3689-a23f-4df9-9cb5-62fc1806337a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:45.303420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-76be3689-a23f-4df9-9cb5-62fc1806337a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:45.305951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-76be3689-a23f-4df9-9cb5-62fc1806337a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.551494 Dec 21 04:04:45.306557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 68/130] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:44 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:45.495137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-dd15fe4c-e4af-4b72-a2d8-eb725ca14625 req-55df92c1-894c-4260-b498-15ad533c21e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37226a3f-240e-4e04-9813-fa3d109452de", "name": "network-vif-plugged", "status": "completed", "tag": "cebf23f8-0aba-463b-89c6-d9e38a717d77"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:45.517902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:45.517902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:45.540471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-dd15fe4c-e4af-4b72-a2d8-eb725ca14625 req-55df92c1-894c-4260-b498-15ad533c21e0 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:45.544174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-dd15fe4c-e4af-4b72-a2d8-eb725ca14625 req-55df92c1-894c-4260-b498-15ad533c21e0 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:45.593248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-dd15fe4c-e4af-4b72-a2d8-eb725ca14625 req-55df92c1-894c-4260-b498-15ad533c21e0 service nova] Creating event network-vif-plugged:cebf23f8-0aba-463b-89c6-d9e38a717d77 for instance 37226a3f-240e-4e04-9813-fa3d109452de on hv-cinder-73306 Dec 21 04:04:45.599042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-dd15fe4c-e4af-4b72-a2d8-eb725ca14625 req-55df92c1-894c-4260-b498-15ad533c21e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118176 Dec 21 04:04:45.599840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 69/131] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:45 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:04:45.709130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-21081128-eaae-4749-b941-ea7bcd6a1933 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:45.724994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-21081128-eaae-4749-b941-ea7bcd6a1933 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.619133 Dec 21 04:04:45.725655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 63/132] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:45 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:45.856598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d17c9faf-373c-443d-8322-0e5206b3f19c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:45.857913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d17c9faf-373c-443d-8322-0e5206b3f19c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:45.869481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d17c9faf-373c-443d-8322-0e5206b3f19c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:45.870264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d17c9faf-373c-443d-8322-0e5206b3f19c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:45.871518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d17c9faf-373c-443d-8322-0e5206b3f19c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:45.872204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d17c9faf-373c-443d-8322-0e5206b3f19c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:46.183898 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d17c9faf-373c-443d-8322-0e5206b3f19c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:46.212411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d17c9faf-373c-443d-8322-0e5206b3f19c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.366469 Dec 21 04:04:46.224801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 70/133] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:45 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:46.336526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bf18cdbd-3f0f-4cc8-8663-486de9b435c5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:46.337289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bf18cdbd-3f0f-4cc8-8663-486de9b435c5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:46.345354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf18cdbd-3f0f-4cc8-8663-486de9b435c5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:46.345918 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf18cdbd-3f0f-4cc8-8663-486de9b435c5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:46.346929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf18cdbd-3f0f-4cc8-8663-486de9b435c5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:46.347425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf18cdbd-3f0f-4cc8-8663-486de9b435c5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:46.599094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bf18cdbd-3f0f-4cc8-8663-486de9b435c5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:46.616997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bf18cdbd-3f0f-4cc8-8663-486de9b435c5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:46.625148 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bf18cdbd-3f0f-4cc8-8663-486de9b435c5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:46.626641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bf18cdbd-3f0f-4cc8-8663-486de9b435c5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.304059 Dec 21 04:04:46.632042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c82f5d1a-4e88-4627-952a-5259f4e4c9c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:46.632796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c82f5d1a-4e88-4627-952a-5259f4e4c9c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:46.638617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 64/134] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:46 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:46.640813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c82f5d1a-4e88-4627-952a-5259f4e4c9c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:46.641328 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c82f5d1a-4e88-4627-952a-5259f4e4c9c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:46.642183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c82f5d1a-4e88-4627-952a-5259f4e4c9c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:46.642685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c82f5d1a-4e88-4627-952a-5259f4e4c9c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:46.717368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c82f5d1a-4e88-4627-952a-5259f4e4c9c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Going to try to terminate instance {{(pid=94299) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:04:46.751888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1ad09976-8802-46fa-ac7e-92fbca584aba tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:46.752903 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1ad09976-8802-46fa-ac7e-92fbca584aba tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:46.762465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ad09976-8802-46fa-ac7e-92fbca584aba tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:46.763568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ad09976-8802-46fa-ac7e-92fbca584aba tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:46.765274 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ad09976-8802-46fa-ac7e-92fbca584aba tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:46.766179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ad09976-8802-46fa-ac7e-92fbca584aba tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:46.888160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c82f5d1a-4e88-4627-952a-5259f4e4c9c4 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "DELETE /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 204 len: 0 microversion: 2.1 time: 0.264757 Dec 21 04:04:46.889503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 71/135] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:04:46 2020] DELETE /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 21 04:04:46.905418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5f8806c3-90b0-4d5d-9bba-eba31298f262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:46.906199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5f8806c3-90b0-4d5d-9bba-eba31298f262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:46.914600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5f8806c3-90b0-4d5d-9bba-eba31298f262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:46.915145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5f8806c3-90b0-4d5d-9bba-eba31298f262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:46.915976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5f8806c3-90b0-4d5d-9bba-eba31298f262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:46.916474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5f8806c3-90b0-4d5d-9bba-eba31298f262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:47.126582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1ad09976-8802-46fa-ac7e-92fbca584aba tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:47.137267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1ad09976-8802-46fa-ac7e-92fbca584aba tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.394657 Dec 21 04:04:47.138075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 65/136] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:46 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:47.199405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5f8806c3-90b0-4d5d-9bba-eba31298f262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:47.209215 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5f8806c3-90b0-4d5d-9bba-eba31298f262 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1555 microversion: 2.1 time: 0.314954 Dec 21 04:04:47.210003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 72/137] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:46 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1555 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:47.253337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1ff38ee4-dba2-4fdb-b3a2-74f64b43150c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:47.254241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1ff38ee4-dba2-4fdb-b3a2-74f64b43150c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:47.279864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ff38ee4-dba2-4fdb-b3a2-74f64b43150c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:47.282393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ff38ee4-dba2-4fdb-b3a2-74f64b43150c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:47.284988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ff38ee4-dba2-4fdb-b3a2-74f64b43150c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:47.285682 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ff38ee4-dba2-4fdb-b3a2-74f64b43150c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:47.649133 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1ff38ee4-dba2-4fdb-b3a2-74f64b43150c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:47.660010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1ff38ee4-dba2-4fdb-b3a2-74f64b43150c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.431586 Dec 21 04:04:47.660992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 66/138] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:47 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:47.672469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bfc4d29c-2216-4e16-b85f-7c53f2ab0ac1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:47.673080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bfc4d29c-2216-4e16-b85f-7c53f2ab0ac1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:47.697312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bfc4d29c-2216-4e16-b85f-7c53f2ab0ac1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:47.697828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bfc4d29c-2216-4e16-b85f-7c53f2ab0ac1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:47.698681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bfc4d29c-2216-4e16-b85f-7c53f2ab0ac1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:47.699210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bfc4d29c-2216-4e16-b85f-7c53f2ab0ac1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:47.702482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-85b1a374-bf1e-43a3-b256-1290358993f3 req-f1499d1a-1ca9-4aa3-ad01-d4083ec17aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de36eb65-105b-41ce-b7fe-04a39c08724a", "name": "network-vif-plugged", "status": "completed", "tag": "112992d5-34d2-4969-bb40-152ef22b2f72"}, {"server_uuid": "3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c", "name": "network-vif-plugged", "status": "completed", "tag": "f383262c-f81f-4b3d-a438-e84aba847b2b"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:47.723163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:47.723163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:47.751776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-85b1a374-bf1e-43a3-b256-1290358993f3 req-f1499d1a-1ca9-4aa3-ad01-d4083ec17aa8 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:47.752424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-85b1a374-bf1e-43a3-b256-1290358993f3 req-f1499d1a-1ca9-4aa3-ad01-d4083ec17aa8 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:47.781843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-85b1a374-bf1e-43a3-b256-1290358993f3 req-f1499d1a-1ca9-4aa3-ad01-d4083ec17aa8 service nova] Creating event network-vif-plugged:112992d5-34d2-4969-bb40-152ef22b2f72 for instance de36eb65-105b-41ce-b7fe-04a39c08724a on hv-cinder-73306 Dec 21 04:04:47.782416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-85b1a374-bf1e-43a3-b256-1290358993f3 req-f1499d1a-1ca9-4aa3-ad01-d4083ec17aa8 service nova] Creating event network-vif-plugged:f383262c-f81f-4b3d-a438-e84aba847b2b for instance 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c on hv-cinder-73306 Dec 21 04:04:47.790487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-85b1a374-bf1e-43a3-b256-1290358993f3 req-f1499d1a-1ca9-4aa3-ad01-d4083ec17aa8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102513 Dec 21 04:04:47.791579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 67/139] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:47 2020] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:48.014008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bfc4d29c-2216-4e16-b85f-7c53f2ab0ac1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:48.057600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bfc4d29c-2216-4e16-b85f-7c53f2ab0ac1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:48.075431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bfc4d29c-2216-4e16-b85f-7c53f2ab0ac1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:48.082501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bfc4d29c-2216-4e16-b85f-7c53f2ab0ac1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1408 microversion: 2.20 time: 0.440534 Dec 21 04:04:48.087077 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 73/140] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:47 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1408 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:04:48.172902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5b4880dd-2e2e-40f7-91bf-6a2b430ae4d2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:48.175545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5b4880dd-2e2e-40f7-91bf-6a2b430ae4d2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:48.204471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b4880dd-2e2e-40f7-91bf-6a2b430ae4d2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:48.205060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b4880dd-2e2e-40f7-91bf-6a2b430ae4d2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:48.206169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b4880dd-2e2e-40f7-91bf-6a2b430ae4d2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:48.206701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b4880dd-2e2e-40f7-91bf-6a2b430ae4d2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:48.235613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-31397f4f-777d-4d17-a465-6432d9220adb tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:48.243377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-31397f4f-777d-4d17-a465-6432d9220adb tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:48.263608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31397f4f-777d-4d17-a465-6432d9220adb tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:48.264144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31397f4f-777d-4d17-a465-6432d9220adb tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:48.264991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31397f4f-777d-4d17-a465-6432d9220adb tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:48.265837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31397f4f-777d-4d17-a465-6432d9220adb tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:48.738014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-31397f4f-777d-4d17-a465-6432d9220adb tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:48.749692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-31397f4f-777d-4d17-a465-6432d9220adb tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1555 microversion: 2.1 time: 0.524830 Dec 21 04:04:48.750485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 74/141] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:48 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1555 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:48.761568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5b4880dd-2e2e-40f7-91bf-6a2b430ae4d2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:48.770166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5b4880dd-2e2e-40f7-91bf-6a2b430ae4d2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.618572 Dec 21 04:04:48.770776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 68/142] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:48 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:48.798512 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ec1ae8df-37ea-4a6b-ac48-8b46bf65fac7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:48.799569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ec1ae8df-37ea-4a6b-ac48-8b46bf65fac7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:48.817669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec1ae8df-37ea-4a6b-ac48-8b46bf65fac7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:48.823825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec1ae8df-37ea-4a6b-ac48-8b46bf65fac7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:48.824877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec1ae8df-37ea-4a6b-ac48-8b46bf65fac7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:48.825542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec1ae8df-37ea-4a6b-ac48-8b46bf65fac7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:49.110882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2bb8357f-4bbf-4730-8842-1249fa119054 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:49.112167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2bb8357f-4bbf-4730-8842-1249fa119054 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:49.122056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bb8357f-4bbf-4730-8842-1249fa119054 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:49.122765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bb8357f-4bbf-4730-8842-1249fa119054 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:49.123766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bb8357f-4bbf-4730-8842-1249fa119054 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:49.124414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bb8357f-4bbf-4730-8842-1249fa119054 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:49.219798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ec1ae8df-37ea-4a6b-ac48-8b46bf65fac7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:49.257395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ec1ae8df-37ea-4a6b-ac48-8b46bf65fac7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.481746 Dec 21 04:04:49.258143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 75/143] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:48 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:49.450418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2bb8357f-4bbf-4730-8842-1249fa119054 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:49.472933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2bb8357f-4bbf-4730-8842-1249fa119054 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:49.489972 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2bb8357f-4bbf-4730-8842-1249fa119054 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:49.491856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2bb8357f-4bbf-4730-8842-1249fa119054 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1599 microversion: 2.20 time: 0.390778 Dec 21 04:04:49.493072 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 69/144] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:04:49 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1599 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:04:49.535718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b417fea0-010a-4992-9bf5-2bb686d7c517 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:49.536269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b417fea0-010a-4992-9bf5-2bb686d7c517 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:49.560525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b417fea0-010a-4992-9bf5-2bb686d7c517 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:49.560755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b417fea0-010a-4992-9bf5-2bb686d7c517 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:49.561921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b417fea0-010a-4992-9bf5-2bb686d7c517 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:49.562420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b417fea0-010a-4992-9bf5-2bb686d7c517 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:49.775019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b417fea0-010a-4992-9bf5-2bb686d7c517 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.267546 Dec 21 04:04:49.775794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 76/145] 10.222.0.16 () {60 vars in 1306 bytes} [Mon Dec 21 04:04:49 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/os-interface => generated 284 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:04:49.783816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7bae1ae8-a845-4e60-bc72-567cb7a921dc tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:49.784602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7bae1ae8-a845-4e60-bc72-567cb7a921dc tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:49.795375 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7bae1ae8-a845-4e60-bc72-567cb7a921dc tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:49.796115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7bae1ae8-a845-4e60-bc72-567cb7a921dc tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:49.797215 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7bae1ae8-a845-4e60-bc72-567cb7a921dc tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:49.797809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7bae1ae8-a845-4e60-bc72-567cb7a921dc tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:49.815834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-68112859-920b-4a2e-80f7-5c49c89b1843 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:49.821590 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-68112859-920b-4a2e-80f7-5c49c89b1843 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:49.843242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68112859-920b-4a2e-80f7-5c49c89b1843 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:49.846332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68112859-920b-4a2e-80f7-5c49c89b1843 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:49.847389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68112859-920b-4a2e-80f7-5c49c89b1843 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:49.849091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68112859-920b-4a2e-80f7-5c49c89b1843 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:50.161156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-68112859-920b-4a2e-80f7-5c49c89b1843 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:50.170994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-68112859-920b-4a2e-80f7-5c49c89b1843 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.382269 Dec 21 04:04:50.171902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 77/146] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:49 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:50.191610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-d642e273-8c0f-4e06-974a-14c1e19d39e5 req-126e745d-8b4b-4933-bcd3-629bbf9a4985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066ef53e-6421-4004-bd12-2e238a638cd1", "name": "network-vif-plugged", "status": "completed", "tag": "3f4c4622-8f1b-42c5-bfc5-c5e155218d89"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:50.199995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:50.199995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:50.211227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-d642e273-8c0f-4e06-974a-14c1e19d39e5 req-126e745d-8b4b-4933-bcd3-629bbf9a4985 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:50.212150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-d642e273-8c0f-4e06-974a-14c1e19d39e5 req-126e745d-8b4b-4933-bcd3-629bbf9a4985 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:50.232735 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-d642e273-8c0f-4e06-974a-14c1e19d39e5 req-126e745d-8b4b-4933-bcd3-629bbf9a4985 service nova] Creating event network-vif-plugged:3f4c4622-8f1b-42c5-bfc5-c5e155218d89 for instance 066ef53e-6421-4004-bd12-2e238a638cd1 on hv-cinder-73306 Dec 21 04:04:50.238935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-d642e273-8c0f-4e06-974a-14c1e19d39e5 req-126e745d-8b4b-4933-bcd3-629bbf9a4985 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065566 Dec 21 04:04:50.242266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 78/147] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:50 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:50.302429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-533622a6-6925-450e-9d6c-252f3d7be26d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:50.308800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-533622a6-6925-450e-9d6c-252f3d7be26d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:50.323254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-533622a6-6925-450e-9d6c-252f3d7be26d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:50.326640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-533622a6-6925-450e-9d6c-252f3d7be26d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:50.327718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-533622a6-6925-450e-9d6c-252f3d7be26d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:50.328909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-533622a6-6925-450e-9d6c-252f3d7be26d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:50.363854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7bae1ae8-a845-4e60-bc72-567cb7a921dc tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:50.387085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7bae1ae8-a845-4e60-bc72-567cb7a921dc tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1555 microversion: 2.1 time: 0.621674 Dec 21 04:04:50.387706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 70/148] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:49 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1555 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:50.653631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-533622a6-6925-450e-9d6c-252f3d7be26d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:50.670665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-533622a6-6925-450e-9d6c-252f3d7be26d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.398822 Dec 21 04:04:50.671731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 79/149] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:50 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:51.198192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-75e92a6e-f630-4dd6-9f1f-97e326ba9d54 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:51.199708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-75e92a6e-f630-4dd6-9f1f-97e326ba9d54 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:51.209797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75e92a6e-f630-4dd6-9f1f-97e326ba9d54 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:51.211397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75e92a6e-f630-4dd6-9f1f-97e326ba9d54 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:51.212752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75e92a6e-f630-4dd6-9f1f-97e326ba9d54 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:51.213747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75e92a6e-f630-4dd6-9f1f-97e326ba9d54 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:51.416570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-aaaeb85b-297a-417a-bc62-8387fc7fffd5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:51.418424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-aaaeb85b-297a-417a-bc62-8387fc7fffd5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:51.427597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aaaeb85b-297a-417a-bc62-8387fc7fffd5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:51.429524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aaaeb85b-297a-417a-bc62-8387fc7fffd5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:51.430816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aaaeb85b-297a-417a-bc62-8387fc7fffd5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:51.431579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aaaeb85b-297a-417a-bc62-8387fc7fffd5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:51.698684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-75e92a6e-f630-4dd6-9f1f-97e326ba9d54 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:51.720420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-75e92a6e-f630-4dd6-9f1f-97e326ba9d54 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 0.534545 Dec 21 04:04:51.724592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 71/150] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:51 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:51.746808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9747587d-7fb5-4dc1-b078-7cf864fb1697 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:51.746808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9747587d-7fb5-4dc1-b078-7cf864fb1697 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:51.756200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9747587d-7fb5-4dc1-b078-7cf864fb1697 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:51.756881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9747587d-7fb5-4dc1-b078-7cf864fb1697 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:51.759235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9747587d-7fb5-4dc1-b078-7cf864fb1697 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:51.760014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9747587d-7fb5-4dc1-b078-7cf864fb1697 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:51.912838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-aaaeb85b-297a-417a-bc62-8387fc7fffd5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:51.924250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-aaaeb85b-297a-417a-bc62-8387fc7fffd5 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1555 microversion: 2.1 time: 0.522635 Dec 21 04:04:51.925388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 80/151] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:51 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1555 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:52.284500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9747587d-7fb5-4dc1-b078-7cf864fb1697 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:52.302621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9747587d-7fb5-4dc1-b078-7cf864fb1697 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1364 microversion: 2.1 time: 0.576602 Dec 21 04:04:52.303490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 72/152] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:51 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1364 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:52.423135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-83adfd9c-efe1-4095-987c-4b76fd38cad1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:52.424000 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-240a734a-95e1-4fbc-9b60-627624d71172 req-4cfa16f6-32de-4813-bb77-91e371c5305c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37226a3f-240e-4e04-9813-fa3d109452de", "tag": "cebf23f8-0aba-463b-89c6-d9e38a717d77"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:52.425921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-83adfd9c-efe1-4095-987c-4b76fd38cad1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:52.442454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:52.442454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:52.442709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83adfd9c-efe1-4095-987c-4b76fd38cad1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:52.443218 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83adfd9c-efe1-4095-987c-4b76fd38cad1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:52.445591 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83adfd9c-efe1-4095-987c-4b76fd38cad1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:52.446298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83adfd9c-efe1-4095-987c-4b76fd38cad1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:52.467790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-240a734a-95e1-4fbc-9b60-627624d71172 req-4cfa16f6-32de-4813-bb77-91e371c5305c service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:52.468313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-240a734a-95e1-4fbc-9b60-627624d71172 req-4cfa16f6-32de-4813-bb77-91e371c5305c service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:52.521376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-240a734a-95e1-4fbc-9b60-627624d71172 req-4cfa16f6-32de-4813-bb77-91e371c5305c service nova] Creating event network-changed:cebf23f8-0aba-463b-89c6-d9e38a717d77 for instance 37226a3f-240e-4e04-9813-fa3d109452de on hv-cinder-73306 Dec 21 04:04:52.556766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-240a734a-95e1-4fbc-9b60-627624d71172 req-4cfa16f6-32de-4813-bb77-91e371c5305c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149970 Dec 21 04:04:52.557518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 73/153] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:52 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:52.724874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-83adfd9c-efe1-4095-987c-4b76fd38cad1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 14 microversion: 2.20 time: 0.343491 Dec 21 04:04:52.729257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 81/154] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:04:52 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 14 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:52.748377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3d2cd7c6-f886-45b3-bbc2-5821a74d4f85 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:52.749152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3d2cd7c6-f886-45b3-bbc2-5821a74d4f85 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:52.769668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d2cd7c6-f886-45b3-bbc2-5821a74d4f85 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:52.772277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d2cd7c6-f886-45b3-bbc2-5821a74d4f85 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:52.777382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d2cd7c6-f886-45b3-bbc2-5821a74d4f85 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:52.778089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d2cd7c6-f886-45b3-bbc2-5821a74d4f85 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:52.909466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-ec6b513f-5b73-44c8-8192-ef20cddb6698 req-f6c7a0fc-1d93-4944-9f9b-4d4688994279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7310cf50-d008-4e86-94b0-9a1a0e0c8fad", "name": "network-vif-unplugged", "status": "completed", "tag": "e659557b-9fe0-4ca8-b96e-86df08ff2db2"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:52.928004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:52.928004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:52.974361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-ec6b513f-5b73-44c8-8192-ef20cddb6698 req-f6c7a0fc-1d93-4944-9f9b-4d4688994279 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:52.975243 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-ec6b513f-5b73-44c8-8192-ef20cddb6698 req-f6c7a0fc-1d93-4944-9f9b-4d4688994279 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:53.006481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-ec6b513f-5b73-44c8-8192-ef20cddb6698 req-f6c7a0fc-1d93-4944-9f9b-4d4688994279 service nova] Creating event network-vif-unplugged:e659557b-9fe0-4ca8-b96e-86df08ff2db2 for instance 7310cf50-d008-4e86-94b0-9a1a0e0c8fad on hv-cinder-73306 Dec 21 04:04:53.018575 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-ec6b513f-5b73-44c8-8192-ef20cddb6698 req-f6c7a0fc-1d93-4944-9f9b-4d4688994279 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130882 Dec 21 04:04:53.021696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 82/155] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:52 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:04:53.054535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-065722e6-b0f1-41f8-9043-1055fb97c27a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:53.056274 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-065722e6-b0f1-41f8-9043-1055fb97c27a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:53.072000 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-065722e6-b0f1-41f8-9043-1055fb97c27a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:53.072520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-065722e6-b0f1-41f8-9043-1055fb97c27a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:53.073381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-065722e6-b0f1-41f8-9043-1055fb97c27a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:53.073878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-065722e6-b0f1-41f8-9043-1055fb97c27a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:53.361207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-065722e6-b0f1-41f8-9043-1055fb97c27a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:53.375987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-065722e6-b0f1-41f8-9043-1055fb97c27a tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1555 microversion: 2.1 time: 0.352682 Dec 21 04:04:53.386298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 83/156] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:53 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1555 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:53.397385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8abbe559-e210-457f-86da-285b836cb2e0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:53.398605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8abbe559-e210-457f-86da-285b836cb2e0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:53.409732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8abbe559-e210-457f-86da-285b836cb2e0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:53.410249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8abbe559-e210-457f-86da-285b836cb2e0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:53.411187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8abbe559-e210-457f-86da-285b836cb2e0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:53.411691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8abbe559-e210-457f-86da-285b836cb2e0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:53.680492 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8abbe559-e210-457f-86da-285b836cb2e0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:53.702993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8abbe559-e210-457f-86da-285b836cb2e0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1551 microversion: 2.1 time: 0.324875 Dec 21 04:04:53.708357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 84/157] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:53 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1551 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:53.738787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-caec6ebb-483d-4af2-a969-d476488a2173 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:53.739386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-caec6ebb-483d-4af2-a969-d476488a2173 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:53.756646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-caec6ebb-483d-4af2-a969-d476488a2173 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:53.760754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-caec6ebb-483d-4af2-a969-d476488a2173 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:53.761698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-caec6ebb-483d-4af2-a969-d476488a2173 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:53.762213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-caec6ebb-483d-4af2-a969-d476488a2173 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:53.945802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3d2cd7c6-f886-45b3-bbc2-5821a74d4f85 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:53.968999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3d2cd7c6-f886-45b3-bbc2-5821a74d4f85 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1320 microversion: 2.1 time: 1.230665 Dec 21 04:04:53.981632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 74/158] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:52 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1320 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:54.007273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-850e18f9-468e-4713-b78e-b62944b99cf2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:54.008713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-850e18f9-468e-4713-b78e-b62944b99cf2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:54.049085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-850e18f9-468e-4713-b78e-b62944b99cf2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:54.049568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-850e18f9-468e-4713-b78e-b62944b99cf2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:54.050430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-850e18f9-468e-4713-b78e-b62944b99cf2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:54.053130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-850e18f9-468e-4713-b78e-b62944b99cf2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:54.242053 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-850e18f9-468e-4713-b78e-b62944b99cf2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 14 microversion: 2.20 time: 0.258016 Dec 21 04:04:54.243198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 75/159] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:04:53 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 14 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:54.311460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-caec6ebb-483d-4af2-a969-d476488a2173 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.591103 Dec 21 04:04:54.313080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 85/160] 10.222.0.16 () {58 vars in 1265 bytes} [Mon Dec 21 04:04:53 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/os-interface => generated 285 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:54.410865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f73c3b83-b3a2-491f-bbe0-ee5638d98d07 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:54.415143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f73c3b83-b3a2-491f-bbe0-ee5638d98d07 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:54.434998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f73c3b83-b3a2-491f-bbe0-ee5638d98d07 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:54.435513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f73c3b83-b3a2-491f-bbe0-ee5638d98d07 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:54.454871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f73c3b83-b3a2-491f-bbe0-ee5638d98d07 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:54.455474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f73c3b83-b3a2-491f-bbe0-ee5638d98d07 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:54.999277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-634ecb99-bfed-4dec-85ac-1338ff1d6af8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:55.000156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-634ecb99-bfed-4dec-85ac-1338ff1d6af8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:55.018305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-634ecb99-bfed-4dec-85ac-1338ff1d6af8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:55.024290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-634ecb99-bfed-4dec-85ac-1338ff1d6af8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:55.026750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-634ecb99-bfed-4dec-85ac-1338ff1d6af8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:55.032985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-634ecb99-bfed-4dec-85ac-1338ff1d6af8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:55.076176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f73c3b83-b3a2-491f-bbe0-ee5638d98d07 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:55.101482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f73c3b83-b3a2-491f-bbe0-ee5638d98d07 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1555 microversion: 2.1 time: 0.710448 Dec 21 04:04:55.123816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 76/161] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:54 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1555 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:55.259563 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-383712ea-8c27-4af8-9315-24ae0697b4ac tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:55.272074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-383712ea-8c27-4af8-9315-24ae0697b4ac tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:55.280806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-383712ea-8c27-4af8-9315-24ae0697b4ac tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:55.281317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-383712ea-8c27-4af8-9315-24ae0697b4ac tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:55.282170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-383712ea-8c27-4af8-9315-24ae0697b4ac tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:55.282663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-383712ea-8c27-4af8-9315-24ae0697b4ac tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:55.406098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-383712ea-8c27-4af8-9315-24ae0697b4ac tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 14 microversion: 2.20 time: 0.156578 Dec 21 04:04:55.406797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 77/162] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:04:55 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:04:55.904455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-634ecb99-bfed-4dec-85ac-1338ff1d6af8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:55.919977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-634ecb99-bfed-4dec-85ac-1338ff1d6af8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1515 microversion: 2.1 time: 0.935898 Dec 21 04:04:55.931239 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 86/163] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:54 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1515 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:55.959891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d0b0fe31-b573-4332-a305-bdf80ff611f8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:55.961125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d0b0fe31-b573-4332-a305-bdf80ff611f8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:55.971717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d0b0fe31-b573-4332-a305-bdf80ff611f8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:55.972214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d0b0fe31-b573-4332-a305-bdf80ff611f8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:55.973072 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d0b0fe31-b573-4332-a305-bdf80ff611f8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:55.973577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d0b0fe31-b573-4332-a305-bdf80ff611f8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:56.055655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-d0b0fe31-b573-4332-a305-bdf80ff611f8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lazy-loading 'flavor' on Instance uuid de36eb65-105b-41ce-b7fe-04a39c08724a {{(pid=94298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:04:56.153070 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a0a46851-43c2-4630-af3d-a56b78ea48c1 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:56.154038 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a0a46851-43c2-4630-af3d-a56b78ea48c1 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:56.177648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0a46851-43c2-4630-af3d-a56b78ea48c1 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:56.180236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0a46851-43c2-4630-af3d-a56b78ea48c1 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:56.181087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0a46851-43c2-4630-af3d-a56b78ea48c1 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:56.186435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0a46851-43c2-4630-af3d-a56b78ea48c1 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:56.312362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d0b0fe31-b573-4332-a305-bdf80ff611f8 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "POST /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a/action" status: 200 len: 32 microversion: 2.1 time: 0.372894 Dec 21 04:04:56.313041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 78/164] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:04:55 2020] POST /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a/action => generated 32 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:04:56.358473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-326564151", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "networks": [{"uuid": "cbe98613-5022-44ed-8fff-023841696a00"}]}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:56.451690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] validate_networks() for [('cbe98613-5022-44ed-8fff-023841696a00', None, None, None)] {{(pid=94298) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:04:56.582878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a0a46851-43c2-4630-af3d-a56b78ea48c1 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:56.601633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a0a46851-43c2-4630-af3d-a56b78ea48c1 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1513 microversion: 2.1 time: 0.463396 Dec 21 04:04:56.607678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 87/165] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:56 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1513 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:56.628142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1ba68434-b68a-481d-a323-3f107f06b3ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:56.632853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1ba68434-b68a-481d-a323-3f107f06b3ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:56.651716 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ba68434-b68a-481d-a323-3f107f06b3ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:56.655114 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ba68434-b68a-481d-a323-3f107f06b3ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:56.656132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ba68434-b68a-481d-a323-3f107f06b3ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:56.659376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ba68434-b68a-481d-a323-3f107f06b3ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:57.435208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1ba68434-b68a-481d-a323-3f107f06b3ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:57.495056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1ba68434-b68a-481d-a323-3f107f06b3ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.885133 Dec 21 04:04:57.495685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 88/166] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:56 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:57.533474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-50110ac9-a778-44a0-9d7b-00d1e7a3421a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:57.534658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-50110ac9-a778-44a0-9d7b-00d1e7a3421a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:57.572359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50110ac9-a778-44a0-9d7b-00d1e7a3421a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:57.572866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50110ac9-a778-44a0-9d7b-00d1e7a3421a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:57.573721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50110ac9-a778-44a0-9d7b-00d1e7a3421a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:57.574219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50110ac9-a778-44a0-9d7b-00d1e7a3421a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:57.707524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-50110ac9-a778-44a0-9d7b-00d1e7a3421a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 14 microversion: 2.20 time: 0.210413 Dec 21 04:04:57.708493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 89/167] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:04:57 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:57.727635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-0913a9c0-e912-426a-8e1e-f25763fcfded req-37b527c8-2daf-4547-b28b-990382b88a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7310cf50-d008-4e86-94b0-9a1a0e0c8fad", "name": "network-vif-deleted", "tag": "e659557b-9fe0-4ca8-b96e-86df08ff2db2"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:57.735176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:57.735176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:57.750122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-0913a9c0-e912-426a-8e1e-f25763fcfded req-37b527c8-2daf-4547-b28b-990382b88a8b service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:57.751254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-0913a9c0-e912-426a-8e1e-f25763fcfded req-37b527c8-2daf-4547-b28b-990382b88a8b service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:57.775496 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-0913a9c0-e912-426a-8e1e-f25763fcfded req-37b527c8-2daf-4547-b28b-990382b88a8b service nova] Creating event network-vif-deleted:e659557b-9fe0-4ca8-b96e-86df08ff2db2 for instance 7310cf50-d008-4e86-94b0-9a1a0e0c8fad on hv-cinder-73306 Dec 21 04:04:57.780737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-0913a9c0-e912-426a-8e1e-f25763fcfded req-37b527c8-2daf-4547-b28b-990382b88a8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065027 Dec 21 04:04:57.781614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 90/168] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:57 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:57.801977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ca7deb73-462c-49a0-9dbf-e4e3a69b8e7a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:57.807605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ca7deb73-462c-49a0-9dbf-e4e3a69b8e7a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:57.825354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca7deb73-462c-49a0-9dbf-e4e3a69b8e7a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:57.826665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca7deb73-462c-49a0-9dbf-e4e3a69b8e7a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:57.827739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca7deb73-462c-49a0-9dbf-e4e3a69b8e7a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:57.828634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca7deb73-462c-49a0-9dbf-e4e3a69b8e7a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:57.952163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ca7deb73-462c-49a0-9dbf-e4e3a69b8e7a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 14 microversion: 2.1 time: 0.168851 Dec 21 04:04:57.953127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 91/169] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:04:57 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:04:57.969883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-997c1acf-702f-44d2-86bc-63fa86362b7f req-0f5715dd-38ac-47f4-a3d2-e6ce210f669d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c", "tag": "f383262c-f81f-4b3d-a438-e84aba847b2b"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:57.996890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:57.996890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:04:58.021382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-997c1acf-702f-44d2-86bc-63fa86362b7f req-0f5715dd-38ac-47f4-a3d2-e6ce210f669d service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:58.021887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-997c1acf-702f-44d2-86bc-63fa86362b7f req-0f5715dd-38ac-47f4-a3d2-e6ce210f669d service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:58.057163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-997c1acf-702f-44d2-86bc-63fa86362b7f req-0f5715dd-38ac-47f4-a3d2-e6ce210f669d service nova] Creating event network-changed:f383262c-f81f-4b3d-a438-e84aba847b2b for instance 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c on hv-cinder-73306 Dec 21 04:04:58.066693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-997c1acf-702f-44d2-86bc-63fa86362b7f req-0f5715dd-38ac-47f4-a3d2-e6ce210f669d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111796 Dec 21 04:04:58.067566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 92/170] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:04:57 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:04:58.080227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8f8ff238-13c1-49d0-bf88-4f2e3f0df015 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:58.081015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8f8ff238-13c1-49d0-bf88-4f2e3f0df015 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:58.089977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f8ff238-13c1-49d0-bf88-4f2e3f0df015 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:58.090493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f8ff238-13c1-49d0-bf88-4f2e3f0df015 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:58.091996 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f8ff238-13c1-49d0-bf88-4f2e3f0df015 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:58.092515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f8ff238-13c1-49d0-bf88-4f2e3f0df015 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:58.202184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f8ff238-13c1-49d0-bf88-4f2e3f0df015 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:58.203283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f8ff238-13c1-49d0-bf88-4f2e3f0df015 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:58.203964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-8f8ff238-13c1-49d0-bf88-4f2e3f0df015 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lazy-loading 'fault' on Instance uuid 7310cf50-d008-4e86-94b0-9a1a0e0c8fad {{(pid=94299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:04:58.298706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8f8ff238-13c1-49d0-bf88-4f2e3f0df015 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c136da2277dd478bbe4a48374dcae3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b459303bfe44888e8f61b8a2800f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:58.319746 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8f8ff238-13c1-49d0-bf88-4f2e3f0df015 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 200 len: 1351 microversion: 2.1 time: 0.250588 Dec 21 04:04:58.320564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 93/171] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:58 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 1351 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:58.523355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7fcc5863-fd89-4a8e-aa43-389760597dfe tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:58.526976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7fcc5863-fd89-4a8e-aa43-389760597dfe tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:58.565318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7fcc5863-fd89-4a8e-aa43-389760597dfe tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:58.565841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7fcc5863-fd89-4a8e-aa43-389760597dfe tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:58.569211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7fcc5863-fd89-4a8e-aa43-389760597dfe tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:58.575184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Flavor limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:04:58.576836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Image limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:04:58.580300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Flavor pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:04:58.582580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Image pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:04:58.583244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:04:58.598205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7fcc5863-fd89-4a8e-aa43-389760597dfe tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:58.615810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:58.627738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:58.629061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:58.635616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:58.688090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Getting quotas for project 0d5c999358804f80929d210c54fe1fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:04:58.692734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Getting quotas for user 52adbfb830ce4351a1eca89f2e4392bb and project 0d5c999358804f80929d210c54fe1fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:04:58.716466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Going to run 1 instances... {{(pid=94298) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:04:58.720734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:04:58.834797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-87e302ea-ae41-4ca1-9897-6032d3bebb8b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.520437 Dec 21 04:04:58.836376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 79/172] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:04:56 2020] POST /compute/v2.1/servers => generated 380 bytes in 2523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:04:58.857571 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-59718d5d-a03e-42cd-b789-37a702a6568c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:58.859190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-59718d5d-a03e-42cd-b789-37a702a6568c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:58.881974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-59718d5d-a03e-42cd-b789-37a702a6568c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:58.882663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-59718d5d-a03e-42cd-b789-37a702a6568c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:58.883688 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-59718d5d-a03e-42cd-b789-37a702a6568c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:58.884307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-59718d5d-a03e-42cd-b789-37a702a6568c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:59.057345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7fcc5863-fd89-4a8e-aa43-389760597dfe tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:59.071598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7fcc5863-fd89-4a8e-aa43-389760597dfe tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.561910 Dec 21 04:04:59.075859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 94/173] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:58 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:59.091635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a6203ffb-afb1-4bb7-9cdd-46e1cc8e8ce4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:59.097856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a6203ffb-afb1-4bb7-9cdd-46e1cc8e8ce4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:59.193317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a6203ffb-afb1-4bb7-9cdd-46e1cc8e8ce4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:04:59.206953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a6203ffb-afb1-4bb7-9cdd-46e1cc8e8ce4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1217 microversion: 2.1 time: 0.129919 Dec 21 04:04:59.207566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 95/174] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:59 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:59.249889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cc2b4ecd-e7f0-44f6-8a86-95992913e90d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:04:59.250118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-59718d5d-a03e-42cd-b789-37a702a6568c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 14 microversion: 2.20 time: 0.411802 Dec 21 04:04:59.251031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 80/175] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:04:58 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 14 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:04:59.263994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cc2b4ecd-e7f0-44f6-8a86-95992913e90d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:59.286625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cc2b4ecd-e7f0-44f6-8a86-95992913e90d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:59.287209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cc2b4ecd-e7f0-44f6-8a86-95992913e90d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:59.288718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cc2b4ecd-e7f0-44f6-8a86-95992913e90d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:59.289388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cc2b4ecd-e7f0-44f6-8a86-95992913e90d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:59.352203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6d6229e7-bf18-4922-8388-9d84158cdf37 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:04:59.362971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6d6229e7-bf18-4922-8388-9d84158cdf37 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:04:59.396810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6d6229e7-bf18-4922-8388-9d84158cdf37 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:59.402376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6d6229e7-bf18-4922-8388-9d84158cdf37 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:59.403894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6d6229e7-bf18-4922-8388-9d84158cdf37 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:04:59.404551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6d6229e7-bf18-4922-8388-9d84158cdf37 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:04:59.450887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cc2b4ecd-e7f0-44f6-8a86-95992913e90d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 14 microversion: 2.1 time: 0.230538 Dec 21 04:04:59.451618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 96/176] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:04:59 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 14 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:04:59.552668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-6d6229e7-bf18-4922-8388-9d84158cdf37 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] HTTP exception thrown: Instance 7310cf50-d008-4e86-94b0-9a1a0e0c8fad could not be found. Dec 21 04:04:59.554095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6d6229e7-bf18-4922-8388-9d84158cdf37 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Returning 404 to user: Instance 7310cf50-d008-4e86-94b0-9a1a0e0c8fad could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:04:59.555369 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6d6229e7-bf18-4922-8388-9d84158cdf37 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 404 len: 111 microversion: 2.1 time: 0.220580 Dec 21 04:04:59.556487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 81/177] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:04:59 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 21 04:05:00.109598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2118f32b-2282-462d-af10-8ea5e9ec1388 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:00.110383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2118f32b-2282-462d-af10-8ea5e9ec1388 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:00.129936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2118f32b-2282-462d-af10-8ea5e9ec1388 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:00.130446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2118f32b-2282-462d-af10-8ea5e9ec1388 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:00.131331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2118f32b-2282-462d-af10-8ea5e9ec1388 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:00.131882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2118f32b-2282-462d-af10-8ea5e9ec1388 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:00.236118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1a510dd5-2f8e-4267-a09b-d4f35cb85aef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:00.236815 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1a510dd5-2f8e-4267-a09b-d4f35cb85aef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:00.258631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a510dd5-2f8e-4267-a09b-d4f35cb85aef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:00.259235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a510dd5-2f8e-4267-a09b-d4f35cb85aef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:00.260087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a510dd5-2f8e-4267-a09b-d4f35cb85aef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:00.260580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a510dd5-2f8e-4267-a09b-d4f35cb85aef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:00.502394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1a510dd5-2f8e-4267-a09b-d4f35cb85aef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:00.519792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1a510dd5-2f8e-4267-a09b-d4f35cb85aef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1269 microversion: 2.1 time: 0.297859 Dec 21 04:05:00.531255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 82/178] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:00 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1269 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:00.555101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-979137c0-c90e-44e0-b518-0e77bbe0a885 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:00.556617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-979137c0-c90e-44e0-b518-0e77bbe0a885 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:00.576465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-979137c0-c90e-44e0-b518-0e77bbe0a885 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:00.576977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-979137c0-c90e-44e0-b518-0e77bbe0a885 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:00.580743 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-979137c0-c90e-44e0-b518-0e77bbe0a885 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:00.581449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-979137c0-c90e-44e0-b518-0e77bbe0a885 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:00.612828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2118f32b-2282-462d-af10-8ea5e9ec1388 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:00.627309 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2118f32b-2282-462d-af10-8ea5e9ec1388 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.535759 Dec 21 04:05:00.627932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 97/179] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:00 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:00.650237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d19ad299-e347-419c-892a-38534dfb1056 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:00.650938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d19ad299-e347-419c-892a-38534dfb1056 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:00.658935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d19ad299-e347-419c-892a-38534dfb1056 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:00.659493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d19ad299-e347-419c-892a-38534dfb1056 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:00.660347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d19ad299-e347-419c-892a-38534dfb1056 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:00.660858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d19ad299-e347-419c-892a-38534dfb1056 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:00.792454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d19ad299-e347-419c-892a-38534dfb1056 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 14 microversion: 2.1 time: 0.153046 Dec 21 04:05:00.793439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 98/180] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:00 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:05:00.795677 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-979137c0-c90e-44e0-b518-0e77bbe0a885 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 14 microversion: 2.20 time: 0.266657 Dec 21 04:05:00.797038 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 83/181] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:00 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 14 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:01.350274 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-700c7065-2716-4f34-8a17-c21a96f28c99 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:01.351170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-700c7065-2716-4f34-8a17-c21a96f28c99 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:01.361627 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-700c7065-2716-4f34-8a17-c21a96f28c99 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:01.362134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-700c7065-2716-4f34-8a17-c21a96f28c99 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:01.364102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-700c7065-2716-4f34-8a17-c21a96f28c99 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:01.364602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-700c7065-2716-4f34-8a17-c21a96f28c99 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:01.435432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-700c7065-2716-4f34-8a17-c21a96f28c99 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] HTTP exception thrown: Instance 7310cf50-d008-4e86-94b0-9a1a0e0c8fad could not be found. Dec 21 04:05:01.436838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-700c7065-2716-4f34-8a17-c21a96f28c99 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Returning 404 to user: Instance 7310cf50-d008-4e86-94b0-9a1a0e0c8fad could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:05:01.438120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-700c7065-2716-4f34-8a17-c21a96f28c99 tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "DELETE /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 404 len: 111 microversion: 2.1 time: 0.098794 Dec 21 04:05:01.452899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 99/182] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:05:01 2020] DELETE /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:05:01.470297 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c737018d-d428-4a3f-a961-37807c2d83ee tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:01.471128 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c737018d-d428-4a3f-a961-37807c2d83ee tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] [instance: 7310cf50-d008-4e86-94b0-9a1a0e0c8fad] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:01.481330 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c737018d-d428-4a3f-a961-37807c2d83ee tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:01.482125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c737018d-d428-4a3f-a961-37807c2d83ee tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:01.483388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c737018d-d428-4a3f-a961-37807c2d83ee tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:01.484071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c737018d-d428-4a3f-a961-37807c2d83ee tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:01.552964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-be2c80fa-1c01-4f95-bad1-539f827a97bc tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:01.553270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-be2c80fa-1c01-4f95-bad1-539f827a97bc tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:01.566796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be2c80fa-1c01-4f95-bad1-539f827a97bc tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:01.567332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be2c80fa-1c01-4f95-bad1-539f827a97bc tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:01.568207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be2c80fa-1c01-4f95-bad1-539f827a97bc tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:01.568827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be2c80fa-1c01-4f95-bad1-539f827a97bc tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:01.590210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-c737018d-d428-4a3f-a961-37807c2d83ee tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] HTTP exception thrown: Instance 7310cf50-d008-4e86-94b0-9a1a0e0c8fad could not be found. Dec 21 04:05:01.591886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c737018d-d428-4a3f-a961-37807c2d83ee tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] Returning 404 to user: Instance 7310cf50-d008-4e86-94b0-9a1a0e0c8fad could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:05:01.593131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c737018d-d428-4a3f-a961-37807c2d83ee tempest-DeleteServersTestJSON-1382132459 tempest-DeleteServersTestJSON-1382132459] 10.222.0.16 "GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad" status: 404 len: 111 microversion: 2.1 time: 0.134938 Dec 21 04:05:01.593824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 84/183] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:01 2020] GET /compute/v2.1/servers/7310cf50-d008-4e86-94b0-9a1a0e0c8fad => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:05:01.653311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b0139e80-5043-45d1-97eb-340724c9832b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:01.655030 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b0139e80-5043-45d1-97eb-340724c9832b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:01.676302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b0139e80-5043-45d1-97eb-340724c9832b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:01.676819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b0139e80-5043-45d1-97eb-340724c9832b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:01.677693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b0139e80-5043-45d1-97eb-340724c9832b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:01.678314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b0139e80-5043-45d1-97eb-340724c9832b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:02.223889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b0139e80-5043-45d1-97eb-340724c9832b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:02.246457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b0139e80-5043-45d1-97eb-340724c9832b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.604715 Dec 21 04:05:02.247435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 85/184] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:01 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:02.275382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-038ad1e7-245d-4d17-ba5b-9149338c73b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:02.276965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-038ad1e7-245d-4d17-ba5b-9149338c73b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:02.291026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-038ad1e7-245d-4d17-ba5b-9149338c73b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:02.291745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-038ad1e7-245d-4d17-ba5b-9149338c73b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:02.292793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-038ad1e7-245d-4d17-ba5b-9149338c73b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:02.293454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-038ad1e7-245d-4d17-ba5b-9149338c73b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:02.377910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-be2c80fa-1c01-4f95-bad1-539f827a97bc tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:02.396772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-be2c80fa-1c01-4f95-bad1-539f827a97bc tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1317 microversion: 2.1 time: 0.859507 Dec 21 04:05:02.399532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 100/185] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:01 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1317 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:02.429151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0cb2799d-829e-4c19-ba70-00888f711095 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:02.430236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0cb2799d-829e-4c19-ba70-00888f711095 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:02.439756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0cb2799d-829e-4c19-ba70-00888f711095 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:02.440261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0cb2799d-829e-4c19-ba70-00888f711095 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:02.441354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0cb2799d-829e-4c19-ba70-00888f711095 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:02.441869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0cb2799d-829e-4c19-ba70-00888f711095 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:02.526668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-038ad1e7-245d-4d17-ba5b-9149338c73b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 14 microversion: 2.1 time: 0.277569 Dec 21 04:05:02.529948 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 86/186] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:02 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 14 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:05:02.568020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0cb2799d-829e-4c19-ba70-00888f711095 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 14 microversion: 2.20 time: 0.166931 Dec 21 04:05:02.568948 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 101/187] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:02 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:03.274781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-19ff5a37-ec96-4652-9e0a-cefcd979c415 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:03.279490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-19ff5a37-ec96-4652-9e0a-cefcd979c415 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:03.288156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19ff5a37-ec96-4652-9e0a-cefcd979c415 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:03.288989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19ff5a37-ec96-4652-9e0a-cefcd979c415 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:03.289868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19ff5a37-ec96-4652-9e0a-cefcd979c415 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:03.290368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19ff5a37-ec96-4652-9e0a-cefcd979c415 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:03.427326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6fc9e1c1-1475-4bb2-824f-3eace0334af7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:03.428118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6fc9e1c1-1475-4bb2-824f-3eace0334af7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:03.450640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6fc9e1c1-1475-4bb2-824f-3eace0334af7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:03.451205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6fc9e1c1-1475-4bb2-824f-3eace0334af7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:03.452057 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6fc9e1c1-1475-4bb2-824f-3eace0334af7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:03.452552 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6fc9e1c1-1475-4bb2-824f-3eace0334af7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:03.812886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-19ff5a37-ec96-4652-9e0a-cefcd979c415 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:03.830514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-19ff5a37-ec96-4652-9e0a-cefcd979c415 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.568702 Dec 21 04:05:03.831858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 87/188] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:03 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:03.843937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c86654e1-4e61-4d17-b8d1-10bafc123a24 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:03.845372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c86654e1-4e61-4d17-b8d1-10bafc123a24 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:03.854994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c86654e1-4e61-4d17-b8d1-10bafc123a24 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:03.855507 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c86654e1-4e61-4d17-b8d1-10bafc123a24 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:03.856787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c86654e1-4e61-4d17-b8d1-10bafc123a24 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:03.857732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c86654e1-4e61-4d17-b8d1-10bafc123a24 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:03.981650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c86654e1-4e61-4d17-b8d1-10bafc123a24 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 14 microversion: 2.1 time: 0.148074 Dec 21 04:05:03.983342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 88/189] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:03 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:05:03.999813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9643a99d-d397-4725-8e2c-9776710a95a9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:04.001576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9643a99d-d397-4725-8e2c-9776710a95a9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:04.015517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9643a99d-d397-4725-8e2c-9776710a95a9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:04.017086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9643a99d-d397-4725-8e2c-9776710a95a9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:04.018563 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9643a99d-d397-4725-8e2c-9776710a95a9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:04.019302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9643a99d-d397-4725-8e2c-9776710a95a9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:04.221205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9643a99d-d397-4725-8e2c-9776710a95a9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 415 microversion: 2.20 time: 0.235709 Dec 21 04:05:04.223166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 89/190] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:03 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 415 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:04.335717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6fc9e1c1-1475-4bb2-824f-3eace0334af7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:04.357755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6fc9e1c1-1475-4bb2-824f-3eace0334af7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1317 microversion: 2.1 time: 0.945687 Dec 21 04:05:04.368552 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 102/191] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:03 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1317 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:04.861625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-11078c0e-2c88-4ce9-b9aa-063d9aeb67af tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:04.864918 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-11078c0e-2c88-4ce9-b9aa-063d9aeb67af tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:04.883850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11078c0e-2c88-4ce9-b9aa-063d9aeb67af tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:04.884445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11078c0e-2c88-4ce9-b9aa-063d9aeb67af tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:04.886187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11078c0e-2c88-4ce9-b9aa-063d9aeb67af tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:04.886948 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11078c0e-2c88-4ce9-b9aa-063d9aeb67af tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:05.002878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4b1a3abc-f866-4e97-8ab9-e1e843b649dd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:05.006645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4b1a3abc-f866-4e97-8ab9-e1e843b649dd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:05.034646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b1a3abc-f866-4e97-8ab9-e1e843b649dd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:05.035434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b1a3abc-f866-4e97-8ab9-e1e843b649dd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:05.036453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b1a3abc-f866-4e97-8ab9-e1e843b649dd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:05.036937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b1a3abc-f866-4e97-8ab9-e1e843b649dd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:05.232830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4b1a3abc-f866-4e97-8ab9-e1e843b649dd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 14 microversion: 2.1 time: 0.243008 Dec 21 04:05:05.236399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 103/192] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:04 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 14 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 21 04:05:05.253583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-efa2c5f9-04d8-4362-8889-8dfccbde769e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:05.258301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-efa2c5f9-04d8-4362-8889-8dfccbde769e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:05.277564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efa2c5f9-04d8-4362-8889-8dfccbde769e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:05.280834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efa2c5f9-04d8-4362-8889-8dfccbde769e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:05.281812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efa2c5f9-04d8-4362-8889-8dfccbde769e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:05.283686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efa2c5f9-04d8-4362-8889-8dfccbde769e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:05.449410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-efa2c5f9-04d8-4362-8889-8dfccbde769e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 10744 microversion: 2.20 time: 0.213342 Dec 21 04:05:05.450278 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 104/193] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:05 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 10744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:05.462817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e6fe84ac-0264-4970-8a28-bebd211f910b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:05.463669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e6fe84ac-0264-4970-8a28-bebd211f910b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:05.473363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6fe84ac-0264-4970-8a28-bebd211f910b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:05.473877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6fe84ac-0264-4970-8a28-bebd211f910b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:05.474743 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6fe84ac-0264-4970-8a28-bebd211f910b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:05.475278 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6fe84ac-0264-4970-8a28-bebd211f910b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:05.591582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-11078c0e-2c88-4ce9-b9aa-063d9aeb67af tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:05.615768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-11078c0e-2c88-4ce9-b9aa-063d9aeb67af tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.769501 Dec 21 04:05:05.617045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 90/194] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:04 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:05.627567 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-39029763-db44-48ea-aa6b-372e99dbe543 req-1e9574a7-e0ed-428c-93bd-0319144e4462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2eb7e97-5d80-4ff6-9f49-1ff46651638d", "tag": "6f38357c-d2bf-4d17-b4b1-51ede0023daf"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:05.635802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:05.635802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:05:05.645269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-39029763-db44-48ea-aa6b-372e99dbe543 req-1e9574a7-e0ed-428c-93bd-0319144e4462 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:05.646055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-39029763-db44-48ea-aa6b-372e99dbe543 req-1e9574a7-e0ed-428c-93bd-0319144e4462 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:05.679431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-39029763-db44-48ea-aa6b-372e99dbe543 req-1e9574a7-e0ed-428c-93bd-0319144e4462 service nova] Creating event network-changed:6f38357c-d2bf-4d17-b4b1-51ede0023daf for instance f2eb7e97-5d80-4ff6-9f49-1ff46651638d on hv-cinder-73306 Dec 21 04:05:05.690083 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-39029763-db44-48ea-aa6b-372e99dbe543 req-1e9574a7-e0ed-428c-93bd-0319144e4462 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070298 Dec 21 04:05:05.691369 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 91/195] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:05:05 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:05:05.795091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e6fe84ac-0264-4970-8a28-bebd211f910b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:05.805143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e6fe84ac-0264-4970-8a28-bebd211f910b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1317 microversion: 2.1 time: 0.353338 Dec 21 04:05:05.815500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 105/196] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:05 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:06.253802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-44edf4b8-46bb-4ff6-9002-d12b445ae020 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:06.257207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-44edf4b8-46bb-4ff6-9002-d12b445ae020 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:06.266353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44edf4b8-46bb-4ff6-9002-d12b445ae020 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:06.267246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44edf4b8-46bb-4ff6-9002-d12b445ae020 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:06.268185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44edf4b8-46bb-4ff6-9002-d12b445ae020 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:06.268669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44edf4b8-46bb-4ff6-9002-d12b445ae020 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:06.434648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-44edf4b8-46bb-4ff6-9002-d12b445ae020 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 14 microversion: 2.1 time: 0.193557 Dec 21 04:05:06.436177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 92/197] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:06 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:05:06.471833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-55f926b6-7e75-48ee-8641-b0c4c72031a8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:06.476866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-55f926b6-7e75-48ee-8641-b0c4c72031a8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:06.493995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55f926b6-7e75-48ee-8641-b0c4c72031a8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:06.499557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55f926b6-7e75-48ee-8641-b0c4c72031a8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:06.500638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55f926b6-7e75-48ee-8641-b0c4c72031a8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:06.501333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55f926b6-7e75-48ee-8641-b0c4c72031a8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:06.643761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bce59fd2-b7be-451d-9583-d43defb74fe1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:06.644622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bce59fd2-b7be-451d-9583-d43defb74fe1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:06.655849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bce59fd2-b7be-451d-9583-d43defb74fe1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:06.656400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bce59fd2-b7be-451d-9583-d43defb74fe1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:06.657624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bce59fd2-b7be-451d-9583-d43defb74fe1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:06.658400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bce59fd2-b7be-451d-9583-d43defb74fe1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:06.682488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-55f926b6-7e75-48ee-8641-b0c4c72031a8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 15064 microversion: 2.20 time: 0.224820 Dec 21 04:05:06.684743 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 106/198] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:06 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 15064 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:06.828546 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-79a584bb-cf63-4c35-a847-ba6591439244 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:06.829540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-79a584bb-cf63-4c35-a847-ba6591439244 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:06.839585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-79a584bb-cf63-4c35-a847-ba6591439244 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:06.840039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-79a584bb-cf63-4c35-a847-ba6591439244 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:06.840882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-79a584bb-cf63-4c35-a847-ba6591439244 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:06.841367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-79a584bb-cf63-4c35-a847-ba6591439244 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:07.077517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-79a584bb-cf63-4c35-a847-ba6591439244 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:07.087019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-79a584bb-cf63-4c35-a847-ba6591439244 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1317 microversion: 2.1 time: 0.268330 Dec 21 04:05:07.087833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 107/199] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:06 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:05:07.114539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bce59fd2-b7be-451d-9583-d43defb74fe1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:07.123733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bce59fd2-b7be-451d-9583-d43defb74fe1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.492710 Dec 21 04:05:07.124549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 93/200] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:06 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:07.453054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e3723404-4f56-4e6b-85ed-01ac3cb01774 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:07.454270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e3723404-4f56-4e6b-85ed-01ac3cb01774 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:07.462650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3723404-4f56-4e6b-85ed-01ac3cb01774 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:07.463305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3723404-4f56-4e6b-85ed-01ac3cb01774 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:07.464451 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3723404-4f56-4e6b-85ed-01ac3cb01774 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:07.465042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3723404-4f56-4e6b-85ed-01ac3cb01774 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:07.594878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e3723404-4f56-4e6b-85ed-01ac3cb01774 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 14 microversion: 2.1 time: 0.152307 Dec 21 04:05:07.598431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 108/201] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:07 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:05:07.701687 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3f73362c-5cda-4a36-bb33-00f1d4008c9a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:07.702726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3f73362c-5cda-4a36-bb33-00f1d4008c9a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:07.711690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3f73362c-5cda-4a36-bb33-00f1d4008c9a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:07.712177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3f73362c-5cda-4a36-bb33-00f1d4008c9a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:07.715125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3f73362c-5cda-4a36-bb33-00f1d4008c9a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:07.715125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3f73362c-5cda-4a36-bb33-00f1d4008c9a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:07.846227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3f73362c-5cda-4a36-bb33-00f1d4008c9a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 17861 microversion: 2.20 time: 0.154338 Dec 21 04:05:07.847325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 94/202] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:07 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 17861 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:08.112192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e9206011-ad93-40ba-a88d-4d8a76476064 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:08.113227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e9206011-ad93-40ba-a88d-4d8a76476064 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:08.122180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9206011-ad93-40ba-a88d-4d8a76476064 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:08.122692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9206011-ad93-40ba-a88d-4d8a76476064 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:08.123546 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9206011-ad93-40ba-a88d-4d8a76476064 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:08.124264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9206011-ad93-40ba-a88d-4d8a76476064 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:08.152482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9f36bf5e-a37f-4726-933d-a75878a1791f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:08.153696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9f36bf5e-a37f-4726-933d-a75878a1791f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:08.169182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9f36bf5e-a37f-4726-933d-a75878a1791f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:08.173302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9f36bf5e-a37f-4726-933d-a75878a1791f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:08.173302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9f36bf5e-a37f-4726-933d-a75878a1791f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:08.173302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9f36bf5e-a37f-4726-933d-a75878a1791f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:08.406086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e9206011-ad93-40ba-a88d-4d8a76476064 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:08.437644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e9206011-ad93-40ba-a88d-4d8a76476064 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1317 microversion: 2.1 time: 0.335395 Dec 21 04:05:08.438691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 109/203] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:08 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:08.543765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9f36bf5e-a37f-4726-933d-a75878a1791f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:08.556340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9f36bf5e-a37f-4726-933d-a75878a1791f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.417846 Dec 21 04:05:08.558956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 95/204] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:08 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:08.616517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6993c57a-55eb-48a4-8bde-89ba34e13e67 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:08.617763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6993c57a-55eb-48a4-8bde-89ba34e13e67 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:08.653495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6993c57a-55eb-48a4-8bde-89ba34e13e67 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:08.655760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6993c57a-55eb-48a4-8bde-89ba34e13e67 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:08.657561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6993c57a-55eb-48a4-8bde-89ba34e13e67 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:08.659010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6993c57a-55eb-48a4-8bde-89ba34e13e67 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:08.801456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6993c57a-55eb-48a4-8bde-89ba34e13e67 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 14 microversion: 2.1 time: 0.198713 Dec 21 04:05:08.805321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 110/205] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:08 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:05:08.883113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-03192e53-822e-43bd-8c5d-5a453726e924 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:08.884559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-03192e53-822e-43bd-8c5d-5a453726e924 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:08.893294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03192e53-822e-43bd-8c5d-5a453726e924 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:08.894082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03192e53-822e-43bd-8c5d-5a453726e924 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:08.895174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03192e53-822e-43bd-8c5d-5a453726e924 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:08.895862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03192e53-822e-43bd-8c5d-5a453726e924 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:09.047408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-03192e53-822e-43bd-8c5d-5a453726e924 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 18013 microversion: 2.20 time: 0.192786 Dec 21 04:05:09.052331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 96/206] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:08 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 18013 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:09.470579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-87bc8888-f878-440a-ad2b-c0b6afdfa9cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:09.471449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-87bc8888-f878-440a-ad2b-c0b6afdfa9cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:09.491343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87bc8888-f878-440a-ad2b-c0b6afdfa9cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:09.491857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87bc8888-f878-440a-ad2b-c0b6afdfa9cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:09.493025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87bc8888-f878-440a-ad2b-c0b6afdfa9cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:09.493518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87bc8888-f878-440a-ad2b-c0b6afdfa9cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:09.582377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f64fa1ef-fca4-4836-a964-e6b3542e7c6a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:09.583778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f64fa1ef-fca4-4836-a964-e6b3542e7c6a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:09.593915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f64fa1ef-fca4-4836-a964-e6b3542e7c6a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:09.594425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f64fa1ef-fca4-4836-a964-e6b3542e7c6a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:09.595310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f64fa1ef-fca4-4836-a964-e6b3542e7c6a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:09.595941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f64fa1ef-fca4-4836-a964-e6b3542e7c6a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:09.788595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-87bc8888-f878-440a-ad2b-c0b6afdfa9cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:09.804729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-87bc8888-f878-440a-ad2b-c0b6afdfa9cb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1317 microversion: 2.1 time: 0.345905 Dec 21 04:05:09.806372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 111/207] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:09 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:09.833340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-470767a2-9a9c-4874-afd0-ba9ce05491fd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:09.836165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-470767a2-9a9c-4874-afd0-ba9ce05491fd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:09.847934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-470767a2-9a9c-4874-afd0-ba9ce05491fd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:09.848817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-470767a2-9a9c-4874-afd0-ba9ce05491fd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:09.850231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-470767a2-9a9c-4874-afd0-ba9ce05491fd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:09.851865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-470767a2-9a9c-4874-afd0-ba9ce05491fd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:09.988773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-470767a2-9a9c-4874-afd0-ba9ce05491fd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 14 microversion: 2.1 time: 0.169945 Dec 21 04:05:09.989907 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 112/208] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:09 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:05:10.040208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f64fa1ef-fca4-4836-a964-e6b3542e7c6a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:10.052619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f64fa1ef-fca4-4836-a964-e6b3542e7c6a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.481228 Dec 21 04:05:10.053352 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 97/209] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:09 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:10.067136 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f4827396-031f-4bc4-a80c-7e5293afb2c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:10.068278 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f4827396-031f-4bc4-a80c-7e5293afb2c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:10.089837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-aebabaa3-c022-4785-997a-5973af583c4c req-2f9c71ad-86d5-4977-abcf-ff2197761c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2eb7e97-5d80-4ff6-9f49-1ff46651638d", "name": "network-vif-plugged", "status": "completed", "tag": "6f38357c-d2bf-4d17-b4b1-51ede0023daf"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:10.091846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4827396-031f-4bc4-a80c-7e5293afb2c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:10.095096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4827396-031f-4bc4-a80c-7e5293afb2c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:10.096132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4827396-031f-4bc4-a80c-7e5293afb2c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:10.098819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4827396-031f-4bc4-a80c-7e5293afb2c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:10.110800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:10.110800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:05:10.133946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-aebabaa3-c022-4785-997a-5973af583c4c req-2f9c71ad-86d5-4977-abcf-ff2197761c30 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:10.134708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-aebabaa3-c022-4785-997a-5973af583c4c req-2f9c71ad-86d5-4977-abcf-ff2197761c30 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:10.158085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-aebabaa3-c022-4785-997a-5973af583c4c req-2f9c71ad-86d5-4977-abcf-ff2197761c30 service nova] Creating event network-vif-plugged:6f38357c-d2bf-4d17-b4b1-51ede0023daf for instance f2eb7e97-5d80-4ff6-9f49-1ff46651638d on hv-cinder-73306 Dec 21 04:05:10.166061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-aebabaa3-c022-4785-997a-5973af583c4c req-2f9c71ad-86d5-4977-abcf-ff2197761c30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094428 Dec 21 04:05:10.166633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 98/210] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:05:10 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:05:10.311180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f4827396-031f-4bc4-a80c-7e5293afb2c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 19661 microversion: 2.20 time: 0.254097 Dec 21 04:05:10.312178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 113/211] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:10 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 19661 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:10.835292 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a5dd8b00-7b01-4a8c-8ef0-9e8ad220bdf4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:10.836703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a5dd8b00-7b01-4a8c-8ef0-9e8ad220bdf4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:10.846945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5dd8b00-7b01-4a8c-8ef0-9e8ad220bdf4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:10.847748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5dd8b00-7b01-4a8c-8ef0-9e8ad220bdf4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:10.848808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5dd8b00-7b01-4a8c-8ef0-9e8ad220bdf4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:10.849552 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5dd8b00-7b01-4a8c-8ef0-9e8ad220bdf4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:11.011562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d7c13a74-933b-4166-b97f-33c04bf029b8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:11.013199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d7c13a74-933b-4166-b97f-33c04bf029b8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:11.026623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d7c13a74-933b-4166-b97f-33c04bf029b8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:11.027535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d7c13a74-933b-4166-b97f-33c04bf029b8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:11.028597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d7c13a74-933b-4166-b97f-33c04bf029b8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:11.029284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d7c13a74-933b-4166-b97f-33c04bf029b8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:11.181769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d7c13a74-933b-4166-b97f-33c04bf029b8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 3123 microversion: 2.1 time: 0.183806 Dec 21 04:05:11.182545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 114/212] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:10 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 3123 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:11.196717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e12bfa9e-ff60-488b-9c0a-513da8eb5be6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:11.197554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e12bfa9e-ff60-488b-9c0a-513da8eb5be6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:11.207895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e12bfa9e-ff60-488b-9c0a-513da8eb5be6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:11.213370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e12bfa9e-ff60-488b-9c0a-513da8eb5be6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:11.213370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e12bfa9e-ff60-488b-9c0a-513da8eb5be6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:11.213370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e12bfa9e-ff60-488b-9c0a-513da8eb5be6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:11.288979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a5dd8b00-7b01-4a8c-8ef0-9e8ad220bdf4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:11.298178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a5dd8b00-7b01-4a8c-8ef0-9e8ad220bdf4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1317 microversion: 2.1 time: 0.476823 Dec 21 04:05:11.299371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 99/213] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:10 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:11.338340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-165058af-3893-4650-a607-6d1e259ce84c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:11.339547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-165058af-3893-4650-a607-6d1e259ce84c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:11.354114 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-165058af-3893-4650-a607-6d1e259ce84c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:11.354625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-165058af-3893-4650-a607-6d1e259ce84c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:11.355507 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-165058af-3893-4650-a607-6d1e259ce84c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:11.355998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-165058af-3893-4650-a607-6d1e259ce84c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:11.493982 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e12bfa9e-ff60-488b-9c0a-513da8eb5be6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:11.505320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e12bfa9e-ff60-488b-9c0a-513da8eb5be6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.320132 Dec 21 04:05:11.505916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 115/214] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:11 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:11.520662 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-165058af-3893-4650-a607-6d1e259ce84c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 21439 microversion: 2.20 time: 0.199936 Dec 21 04:05:11.522400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 100/215] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:11 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 21439 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:12.204404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7a8aa3d3-eb9d-4bad-837e-1d5315dc5963 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:12.206173 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7a8aa3d3-eb9d-4bad-837e-1d5315dc5963 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:12.216658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a8aa3d3-eb9d-4bad-837e-1d5315dc5963 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:12.217841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a8aa3d3-eb9d-4bad-837e-1d5315dc5963 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:12.218955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a8aa3d3-eb9d-4bad-837e-1d5315dc5963 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:12.219793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a8aa3d3-eb9d-4bad-837e-1d5315dc5963 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:12.324419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-34c0342c-c257-432b-a6be-e2cae26e881e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:12.325297 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-34c0342c-c257-432b-a6be-e2cae26e881e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:12.334299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34c0342c-c257-432b-a6be-e2cae26e881e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:12.335584 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34c0342c-c257-432b-a6be-e2cae26e881e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:12.336714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34c0342c-c257-432b-a6be-e2cae26e881e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:12.337248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34c0342c-c257-432b-a6be-e2cae26e881e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:12.346418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7a8aa3d3-eb9d-4bad-837e-1d5315dc5963 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 7546 microversion: 2.1 time: 0.156783 Dec 21 04:05:12.350107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 116/216] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:12 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 7546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:12.534475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-85ea808c-2e5e-409d-b8b6-7dda174eca78 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:12.535628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-85ea808c-2e5e-409d-b8b6-7dda174eca78 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:12.545269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-85ea808c-2e5e-409d-b8b6-7dda174eca78 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:12.545780 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-85ea808c-2e5e-409d-b8b6-7dda174eca78 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:12.547269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-85ea808c-2e5e-409d-b8b6-7dda174eca78 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:12.547766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-85ea808c-2e5e-409d-b8b6-7dda174eca78 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:12.581667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-34c0342c-c257-432b-a6be-e2cae26e881e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:12.592182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-34c0342c-c257-432b-a6be-e2cae26e881e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1507 microversion: 2.1 time: 0.278491 Dec 21 04:05:12.593177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 101/217] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:12 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1507 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:12.612117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4da06288-ea63-40cd-8e69-7dffb406b7b3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:12.613914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4da06288-ea63-40cd-8e69-7dffb406b7b3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:12.622790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4da06288-ea63-40cd-8e69-7dffb406b7b3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:12.623499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4da06288-ea63-40cd-8e69-7dffb406b7b3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:12.624504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4da06288-ea63-40cd-8e69-7dffb406b7b3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:12.625144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4da06288-ea63-40cd-8e69-7dffb406b7b3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:12.812019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4da06288-ea63-40cd-8e69-7dffb406b7b3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 22706 microversion: 2.20 time: 0.216525 Dec 21 04:05:12.817116 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 102/218] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:12 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 22706 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:12.827883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-85ea808c-2e5e-409d-b8b6-7dda174eca78 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:12.834354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2448a9e2-1c34-475b-8613-374205c2186f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72dc57a3-ae6e-4e99-959b-7bfeb3314c0f"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:12.836474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2448a9e2-1c34-475b-8613-374205c2186f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:12.837862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-85ea808c-2e5e-409d-b8b6-7dda174eca78 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.318133 Dec 21 04:05:12.838756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 117/219] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:12 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:05:12.856523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2448a9e2-1c34-475b-8613-374205c2186f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:12.858461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2448a9e2-1c34-475b-8613-374205c2186f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:12.860298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2448a9e2-1c34-475b-8613-374205c2186f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:12.863414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2448a9e2-1c34-475b-8613-374205c2186f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:13.338829 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-2448a9e2-1c34-475b-8613-374205c2186f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] HTTP exception thrown: Invalid input received: Invalid volume: Volume 72dc57a3-ae6e-4e99-959b-7bfeb3314c0f status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ce407f60-979c-4966-a5e2-e7cf7c144b82) Dec 21 04:05:13.339830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2448a9e2-1c34-475b-8613-374205c2186f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Returning 400 to user: Invalid input received: Invalid volume: Volume 72dc57a3-ae6e-4e99-959b-7bfeb3314c0f status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ce407f60-979c-4966-a5e2-e7cf7c144b82) {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:05:13.340902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2448a9e2-1c34-475b-8613-374205c2186f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "POST /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d/os-volume_attachments" status: 400 len: 279 microversion: 2.1 time: 0.521569 Dec 21 04:05:13.341809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 103/220] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Dec 21 04:05:12 2020] POST /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d/os-volume_attachments => generated 279 bytes in 523 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 21 04:05:13.367792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3ec96937-881b-487f-9e08-8d052361b3cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:13.369104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3ec96937-881b-487f-9e08-8d052361b3cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:13.377181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ec96937-881b-487f-9e08-8d052361b3cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:13.377862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ec96937-881b-487f-9e08-8d052361b3cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:13.378888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ec96937-881b-487f-9e08-8d052361b3cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:13.379607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ec96937-881b-487f-9e08-8d052361b3cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:13.473614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-168438d9-6f17-4899-b7e0-b0ac5f9fd26e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:13.474290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-168438d9-6f17-4899-b7e0-b0ac5f9fd26e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:13.483726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-168438d9-6f17-4899-b7e0-b0ac5f9fd26e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:13.484239 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-168438d9-6f17-4899-b7e0-b0ac5f9fd26e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:13.485094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-168438d9-6f17-4899-b7e0-b0ac5f9fd26e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:13.485756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-168438d9-6f17-4899-b7e0-b0ac5f9fd26e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:13.565729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3ec96937-881b-487f-9e08-8d052361b3cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 12758 microversion: 2.1 time: 0.210818 Dec 21 04:05:13.567461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 118/221] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:13 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 12758 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:13.799071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-168438d9-6f17-4899-b7e0-b0ac5f9fd26e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "DELETE /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38/os-volume_attachments/72dc57a3-ae6e-4e99-959b-7bfeb3314c0f" status: 202 len: 0 microversion: 2.1 time: 0.339673 Dec 21 04:05:13.800412 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 104/222] 10.222.0.16 () {58 vars in 1406 bytes} [Mon Dec 21 04:05:13 2020] DELETE /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38/os-volume_attachments/72dc57a3-ae6e-4e99-959b-7bfeb3314c0f => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:13.833130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4eb4e1a3-6164-4cca-a964-88da37493170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:13.834271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4eb4e1a3-6164-4cca-a964-88da37493170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:13.866591 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-78ae6f4c-4abb-46b4-84a4-2a187bd9eeb0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:13.867395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-78ae6f4c-4abb-46b4-84a4-2a187bd9eeb0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:13.885176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4eb4e1a3-6164-4cca-a964-88da37493170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:13.892334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-78ae6f4c-4abb-46b4-84a4-2a187bd9eeb0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:13.893065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-78ae6f4c-4abb-46b4-84a4-2a187bd9eeb0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:13.894143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-78ae6f4c-4abb-46b4-84a4-2a187bd9eeb0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:13.895364 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-78ae6f4c-4abb-46b4-84a4-2a187bd9eeb0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:13.895572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4eb4e1a3-6164-4cca-a964-88da37493170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:13.896864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4eb4e1a3-6164-4cca-a964-88da37493170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:13.897739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4eb4e1a3-6164-4cca-a964-88da37493170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:14.147599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4eb4e1a3-6164-4cca-a964-88da37493170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 23789 microversion: 2.20 time: 0.325133 Dec 21 04:05:14.148836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 119/223] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:13 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 23789 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 21 04:05:14.233170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-78ae6f4c-4abb-46b4-84a4-2a187bd9eeb0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:14.243195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-78ae6f4c-4abb-46b4-84a4-2a187bd9eeb0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.390980 Dec 21 04:05:14.244112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 105/224] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:13 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:14.586286 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8d3fd783-7845-4372-b917-647ea2dc541e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:14.587465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8d3fd783-7845-4372-b917-647ea2dc541e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:14.597228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d3fd783-7845-4372-b917-647ea2dc541e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:14.598005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d3fd783-7845-4372-b917-647ea2dc541e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:14.599172 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d3fd783-7845-4372-b917-647ea2dc541e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:14.599904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d3fd783-7845-4372-b917-647ea2dc541e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:14.763964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8d3fd783-7845-4372-b917-647ea2dc541e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 15412 microversion: 2.1 time: 0.187729 Dec 21 04:05:14.765530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 120/225] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:14 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 15412 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:15.165964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b1ce47b5-fd55-4d22-a531-b911f3735ecc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:15.167492 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b1ce47b5-fd55-4d22-a531-b911f3735ecc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:15.176917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1ce47b5-fd55-4d22-a531-b911f3735ecc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:15.177634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1ce47b5-fd55-4d22-a531-b911f3735ecc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:15.179051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1ce47b5-fd55-4d22-a531-b911f3735ecc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:15.180276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1ce47b5-fd55-4d22-a531-b911f3735ecc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:15.267978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fc254c63-24fb-4979-9505-93c7a2976ca9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:15.268893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fc254c63-24fb-4979-9505-93c7a2976ca9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:15.278213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc254c63-24fb-4979-9505-93c7a2976ca9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:15.279715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc254c63-24fb-4979-9505-93c7a2976ca9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:15.281476 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc254c63-24fb-4979-9505-93c7a2976ca9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:15.282258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc254c63-24fb-4979-9505-93c7a2976ca9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:15.333336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b1ce47b5-fd55-4d22-a531-b911f3735ecc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 24218 microversion: 2.20 time: 0.176332 Dec 21 04:05:15.336080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 106/226] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:15 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 24218 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:15.570917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fc254c63-24fb-4979-9505-93c7a2976ca9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:15.583826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fc254c63-24fb-4979-9505-93c7a2976ca9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.325434 Dec 21 04:05:15.585456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 121/227] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:15 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:15.782228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3f0febcb-b9a1-4a63-998d-3de05d2c2b02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:15.783473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3f0febcb-b9a1-4a63-998d-3de05d2c2b02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:15.792543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3f0febcb-b9a1-4a63-998d-3de05d2c2b02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:15.793055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3f0febcb-b9a1-4a63-998d-3de05d2c2b02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:15.793919 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3f0febcb-b9a1-4a63-998d-3de05d2c2b02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:15.794415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3f0febcb-b9a1-4a63-998d-3de05d2c2b02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:15.965101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3f0febcb-b9a1-4a63-998d-3de05d2c2b02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 17781 microversion: 2.1 time: 0.192584 Dec 21 04:05:15.966039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 107/228] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:15 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 17781 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:16.364164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a69b8d36-ebdc-41c2-9b09-b20b0c5dab75 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:16.365506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a69b8d36-ebdc-41c2-9b09-b20b0c5dab75 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:16.377087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a69b8d36-ebdc-41c2-9b09-b20b0c5dab75 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:16.378125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a69b8d36-ebdc-41c2-9b09-b20b0c5dab75 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:16.379015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a69b8d36-ebdc-41c2-9b09-b20b0c5dab75 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:16.379791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a69b8d36-ebdc-41c2-9b09-b20b0c5dab75 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:16.409998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-586699014", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "networks": [{"uuid": "cbe98613-5022-44ed-8fff-023841696a00"}]}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:16.589551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a69b8d36-ebdc-41c2-9b09-b20b0c5dab75 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 25019 microversion: 2.20 time: 0.245858 Dec 21 04:05:16.590513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 122/229] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:16 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 25019 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:16.610443 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7d76cab1-af04-46de-9775-cba586563c29 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:16.611254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7d76cab1-af04-46de-9775-cba586563c29 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:16.629077 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d76cab1-af04-46de-9775-cba586563c29 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:16.629886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d76cab1-af04-46de-9775-cba586563c29 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:16.631236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d76cab1-af04-46de-9775-cba586563c29 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:16.632631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d76cab1-af04-46de-9775-cba586563c29 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:16.890937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7d76cab1-af04-46de-9775-cba586563c29 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:16.907134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7d76cab1-af04-46de-9775-cba586563c29 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.302885 Dec 21 04:05:16.907801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 123/230] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:16 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:16.983840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f576f7d3-7432-4880-b000-5e850c2909d8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:16.984979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f576f7d3-7432-4880-b000-5e850c2909d8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:16.994205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f576f7d3-7432-4880-b000-5e850c2909d8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:16.994806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f576f7d3-7432-4880-b000-5e850c2909d8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:16.995668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f576f7d3-7432-4880-b000-5e850c2909d8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:16.996155 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f576f7d3-7432-4880-b000-5e850c2909d8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:17.146003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f576f7d3-7432-4880-b000-5e850c2909d8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 18997 microversion: 2.1 time: 0.172085 Dec 21 04:05:17.150071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 124/231] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:16 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 18997 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 21 04:05:17.612071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-334b0c88-f079-4efb-b6dd-aaa41e1cf07b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:17.614000 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-334b0c88-f079-4efb-b6dd-aaa41e1cf07b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:17.624695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-334b0c88-f079-4efb-b6dd-aaa41e1cf07b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:17.625478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-334b0c88-f079-4efb-b6dd-aaa41e1cf07b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:17.626759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-334b0c88-f079-4efb-b6dd-aaa41e1cf07b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:17.627471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-334b0c88-f079-4efb-b6dd-aaa41e1cf07b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:17.844201 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-334b0c88-f079-4efb-b6dd-aaa41e1cf07b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 25936 microversion: 2.20 time: 0.245958 Dec 21 04:05:17.844901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 125/232] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:17 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 25936 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 21 04:05:17.933542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fe358ed5-df09-4696-b6ce-8801cbc1fd4c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:17.935066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fe358ed5-df09-4696-b6ce-8801cbc1fd4c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:17.946876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe358ed5-df09-4696-b6ce-8801cbc1fd4c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:17.947743 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe358ed5-df09-4696-b6ce-8801cbc1fd4c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:17.948779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe358ed5-df09-4696-b6ce-8801cbc1fd4c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:17.949459 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe358ed5-df09-4696-b6ce-8801cbc1fd4c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:18.672923 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fe358ed5-df09-4696-b6ce-8801cbc1fd4c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:18.684893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fe358ed5-df09-4696-b6ce-8801cbc1fd4c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.762819 Dec 21 04:05:18.686450 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 126/233] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:17 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:05:18.697886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e54fd0dc-3527-4f4f-86a5-5c1144c792c2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:18.699220 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e54fd0dc-3527-4f4f-86a5-5c1144c792c2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:18.713277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e54fd0dc-3527-4f4f-86a5-5c1144c792c2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:18.713887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e54fd0dc-3527-4f4f-86a5-5c1144c792c2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:18.714857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e54fd0dc-3527-4f4f-86a5-5c1144c792c2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:18.715481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e54fd0dc-3527-4f4f-86a5-5c1144c792c2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:18.890806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e54fd0dc-3527-4f4f-86a5-5c1144c792c2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 21570 microversion: 2.1 time: 0.202748 Dec 21 04:05:18.895920 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 127/234] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:18 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 21570 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:18.908548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-87165531-784a-4e93-a355-4cb9b86ba75d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:18.909915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-87165531-784a-4e93-a355-4cb9b86ba75d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:18.920289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87165531-784a-4e93-a355-4cb9b86ba75d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:18.921054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87165531-784a-4e93-a355-4cb9b86ba75d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:18.922097 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87165531-784a-4e93-a355-4cb9b86ba75d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:18.922805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87165531-784a-4e93-a355-4cb9b86ba75d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:19.102007 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-87165531-784a-4e93-a355-4cb9b86ba75d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 26569 microversion: 2.20 time: 0.203674 Dec 21 04:05:19.103316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 128/235] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:18 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 26569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:19.711333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bdd71544-7fd1-44d7-a5e1-cf8edca65f65 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:19.712120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bdd71544-7fd1-44d7-a5e1-cf8edca65f65 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:19.740425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bdd71544-7fd1-44d7-a5e1-cf8edca65f65 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:19.741393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bdd71544-7fd1-44d7-a5e1-cf8edca65f65 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:19.742661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bdd71544-7fd1-44d7-a5e1-cf8edca65f65 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:19.743331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bdd71544-7fd1-44d7-a5e1-cf8edca65f65 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:20.251379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bdd71544-7fd1-44d7-a5e1-cf8edca65f65 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:20.262252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bdd71544-7fd1-44d7-a5e1-cf8edca65f65 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.560917 Dec 21 04:05:20.279759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 129/236] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:19 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:20.285854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f5531102-b097-4e6e-9c36-8d2a3dc8e358 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:20.287174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f5531102-b097-4e6e-9c36-8d2a3dc8e358 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:20.297564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5531102-b097-4e6e-9c36-8d2a3dc8e358 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:20.298246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5531102-b097-4e6e-9c36-8d2a3dc8e358 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:20.299166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5531102-b097-4e6e-9c36-8d2a3dc8e358 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:20.299667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5531102-b097-4e6e-9c36-8d2a3dc8e358 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:20.462209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f5531102-b097-4e6e-9c36-8d2a3dc8e358 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 22900 microversion: 2.1 time: 0.186584 Dec 21 04:05:20.465365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 130/237] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:20 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 22900 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:20.489984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-76df4e0b-b47e-4f41-867d-5ea0fbad08af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:20.492076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-76df4e0b-b47e-4f41-867d-5ea0fbad08af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:20.515127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76df4e0b-b47e-4f41-867d-5ea0fbad08af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:20.515639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76df4e0b-b47e-4f41-867d-5ea0fbad08af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:20.516494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76df4e0b-b47e-4f41-867d-5ea0fbad08af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:20.516987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76df4e0b-b47e-4f41-867d-5ea0fbad08af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:20.701690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-76df4e0b-b47e-4f41-867d-5ea0fbad08af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 27305 microversion: 2.20 time: 0.234617 Dec 21 04:05:20.703097 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 131/238] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:20 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 27305 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:21.299710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ae6212d5-5cef-4396-8777-637febcd3662 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:21.301412 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ae6212d5-5cef-4396-8777-637febcd3662 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:21.320371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae6212d5-5cef-4396-8777-637febcd3662 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:21.321192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae6212d5-5cef-4396-8777-637febcd3662 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:21.322261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae6212d5-5cef-4396-8777-637febcd3662 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:21.322954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae6212d5-5cef-4396-8777-637febcd3662 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:21.697005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ae6212d5-5cef-4396-8777-637febcd3662 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:21.719321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ae6212d5-5cef-4396-8777-637febcd3662 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.432466 Dec 21 04:05:21.720367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 132/239] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:21 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:21.740169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c6b21932-00ef-4c8f-88fc-8482e5672731 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:21.741791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c6b21932-00ef-4c8f-88fc-8482e5672731 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:21.766825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c6b21932-00ef-4c8f-88fc-8482e5672731 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:21.767016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c6b21932-00ef-4c8f-88fc-8482e5672731 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:21.767866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c6b21932-00ef-4c8f-88fc-8482e5672731 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:21.768365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c6b21932-00ef-4c8f-88fc-8482e5672731 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:21.984983 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c6b21932-00ef-4c8f-88fc-8482e5672731 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 23807 microversion: 2.1 time: 0.263359 Dec 21 04:05:21.989147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 133/240] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:21 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 23807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:22.013906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0115577c-e065-44c5-854a-5d96fb31461d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:22.015172 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0115577c-e065-44c5-854a-5d96fb31461d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:22.044707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0115577c-e065-44c5-854a-5d96fb31461d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:22.045233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0115577c-e065-44c5-854a-5d96fb31461d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:22.046120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0115577c-e065-44c5-854a-5d96fb31461d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:22.046624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0115577c-e065-44c5-854a-5d96fb31461d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:22.221122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0115577c-e065-44c5-854a-5d96fb31461d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 27672 microversion: 2.20 time: 0.233690 Dec 21 04:05:22.222222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 134/241] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:21 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 27672 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:22.745158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ebfdf0d1-321e-4526-91db-052913dea7d4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:22.745944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ebfdf0d1-321e-4526-91db-052913dea7d4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:22.754674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebfdf0d1-321e-4526-91db-052913dea7d4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:22.755235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebfdf0d1-321e-4526-91db-052913dea7d4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:22.756393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebfdf0d1-321e-4526-91db-052913dea7d4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:22.756871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebfdf0d1-321e-4526-91db-052913dea7d4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:23.008713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ebfdf0d1-321e-4526-91db-052913dea7d4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:23.019500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ebfdf0d1-321e-4526-91db-052913dea7d4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.285226 Dec 21 04:05:23.020461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 135/242] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:22 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:23.040564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1fbed280-6e33-40ca-b343-830323da7996 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:23.045080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1fbed280-6e33-40ca-b343-830323da7996 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:23.057668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1fbed280-6e33-40ca-b343-830323da7996 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:23.059168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1fbed280-6e33-40ca-b343-830323da7996 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:23.061043 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1fbed280-6e33-40ca-b343-830323da7996 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:23.063015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1fbed280-6e33-40ca-b343-830323da7996 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:23.216359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1fbed280-6e33-40ca-b343-830323da7996 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 24820 microversion: 2.1 time: 0.194490 Dec 21 04:05:23.217297 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 136/243] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:23 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 24820 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:23.240289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c04bd781-520f-4d79-9162-637ed8c75c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:23.241963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c04bd781-520f-4d79-9162-637ed8c75c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:23.251189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c04bd781-520f-4d79-9162-637ed8c75c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:23.251860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c04bd781-520f-4d79-9162-637ed8c75c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:23.253507 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c04bd781-520f-4d79-9162-637ed8c75c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:23.254006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c04bd781-520f-4d79-9162-637ed8c75c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:23.463933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c04bd781-520f-4d79-9162-637ed8c75c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 27903 microversion: 2.20 time: 0.233766 Dec 21 04:05:23.464918 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 137/244] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:23 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 27903 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 21 04:05:24.044931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e9a2619b-f785-4a21-a0cc-d7776013f219 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:24.045836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e9a2619b-f785-4a21-a0cc-d7776013f219 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:24.058480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9a2619b-f785-4a21-a0cc-d7776013f219 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:24.062350 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9a2619b-f785-4a21-a0cc-d7776013f219 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:24.063461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9a2619b-f785-4a21-a0cc-d7776013f219 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:24.064113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9a2619b-f785-4a21-a0cc-d7776013f219 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:24.621577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e9a2619b-f785-4a21-a0cc-d7776013f219 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:24.639973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e9a2619b-f785-4a21-a0cc-d7776013f219 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.600461 Dec 21 04:05:24.640667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 138/245] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:24 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:05:24.661618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bc44a0f3-9845-4deb-847e-cef7590aad47 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:24.672118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bc44a0f3-9845-4deb-847e-cef7590aad47 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:24.681281 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc44a0f3-9845-4deb-847e-cef7590aad47 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:24.681654 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc44a0f3-9845-4deb-847e-cef7590aad47 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:24.682512 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc44a0f3-9845-4deb-847e-cef7590aad47 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:24.683027 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc44a0f3-9845-4deb-847e-cef7590aad47 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:24.830127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bc44a0f3-9845-4deb-847e-cef7590aad47 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 26049 microversion: 2.1 time: 0.187743 Dec 21 04:05:24.834954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 139/246] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:24 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 26049 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:24.843726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f46bd28f-2e5d-4954-8535-8fa4e20f66a6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:24.844993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f46bd28f-2e5d-4954-8535-8fa4e20f66a6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:24.855199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f46bd28f-2e5d-4954-8535-8fa4e20f66a6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:24.855740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f46bd28f-2e5d-4954-8535-8fa4e20f66a6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:24.856611 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f46bd28f-2e5d-4954-8535-8fa4e20f66a6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:24.857125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f46bd28f-2e5d-4954-8535-8fa4e20f66a6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:25.003843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f46bd28f-2e5d-4954-8535-8fa4e20f66a6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 28149 microversion: 2.20 time: 0.166956 Dec 21 04:05:25.004761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 140/247] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:24 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 28149 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:25.671168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ffce6886-5c24-4f98-8274-7417ede03df1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:25.672621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ffce6886-5c24-4f98-8274-7417ede03df1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:25.685634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ffce6886-5c24-4f98-8274-7417ede03df1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:25.686169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ffce6886-5c24-4f98-8274-7417ede03df1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:25.687099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ffce6886-5c24-4f98-8274-7417ede03df1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:25.687742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ffce6886-5c24-4f98-8274-7417ede03df1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:26.000842 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ffce6886-5c24-4f98-8274-7417ede03df1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:26.015951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ffce6886-5c24-4f98-8274-7417ede03df1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.360728 Dec 21 04:05:26.016804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 141/248] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:25 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:26.028561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b06c8dcb-16de-4a73-9fa8-14f75e157f8a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:26.029946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b06c8dcb-16de-4a73-9fa8-14f75e157f8a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:26.038859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b06c8dcb-16de-4a73-9fa8-14f75e157f8a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:26.039780 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b06c8dcb-16de-4a73-9fa8-14f75e157f8a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:26.040856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b06c8dcb-16de-4a73-9fa8-14f75e157f8a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:26.041548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b06c8dcb-16de-4a73-9fa8-14f75e157f8a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:26.247091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b06c8dcb-16de-4a73-9fa8-14f75e157f8a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 26953 microversion: 2.1 time: 0.228312 Dec 21 04:05:26.247814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 142/249] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:26 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 26953 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:26.276008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f99a7bc6-ff08-4d71-a417-60e689d835ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:26.277164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f99a7bc6-ff08-4d71-a417-60e689d835ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:26.285755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f99a7bc6-ff08-4d71-a417-60e689d835ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:26.286261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f99a7bc6-ff08-4d71-a417-60e689d835ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:26.287135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f99a7bc6-ff08-4d71-a417-60e689d835ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:26.287663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f99a7bc6-ff08-4d71-a417-60e689d835ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:26.417360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f99a7bc6-ff08-4d71-a417-60e689d835ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 28149 microversion: 2.20 time: 0.167376 Dec 21 04:05:26.418891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 143/250] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:26 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 28149 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:27.043170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ea5c1f2d-9061-4e42-af73-006ab42eb5fa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:27.044491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ea5c1f2d-9061-4e42-af73-006ab42eb5fa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:27.053501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea5c1f2d-9061-4e42-af73-006ab42eb5fa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:27.054207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea5c1f2d-9061-4e42-af73-006ab42eb5fa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:27.055089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea5c1f2d-9061-4e42-af73-006ab42eb5fa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:27.055582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea5c1f2d-9061-4e42-af73-006ab42eb5fa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:27.718302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ea5c1f2d-9061-4e42-af73-006ab42eb5fa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:27.729131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ea5c1f2d-9061-4e42-af73-006ab42eb5fa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 0.697856 Dec 21 04:05:27.739416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 144/251] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:27 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:27.744819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-db796112-47ca-46ee-abcb-099030806383 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:27.746177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-db796112-47ca-46ee-abcb-099030806383 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:27.754344 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-db796112-47ca-46ee-abcb-099030806383 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:27.755021 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-db796112-47ca-46ee-abcb-099030806383 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:27.756328 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-db796112-47ca-46ee-abcb-099030806383 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:27.756979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-db796112-47ca-46ee-abcb-099030806383 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:27.883182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] validate_networks() for [('cbe98613-5022-44ed-8fff-023841696a00', None, None, None)] {{(pid=94298) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:05:27.903670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-db796112-47ca-46ee-abcb-099030806383 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 27579 microversion: 2.1 time: 0.168894 Dec 21 04:05:27.905526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 145/252] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:27 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 27579 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:27.931823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5bd2c06d-ca6b-4c3e-bf28-a409acdcf1e3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:27.933159 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5bd2c06d-ca6b-4c3e-bf28-a409acdcf1e3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:27.953175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5bd2c06d-ca6b-4c3e-bf28-a409acdcf1e3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:27.955211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5bd2c06d-ca6b-4c3e-bf28-a409acdcf1e3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:27.956770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5bd2c06d-ca6b-4c3e-bf28-a409acdcf1e3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:27.958040 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5bd2c06d-ca6b-4c3e-bf28-a409acdcf1e3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:28.222505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5bd2c06d-ca6b-4c3e-bf28-a409acdcf1e3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 28362 microversion: 2.20 time: 0.314869 Dec 21 04:05:28.224183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 146/253] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:27 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 28362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:28.559088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Flavor limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:05:28.560276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Image limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:05:28.561383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Flavor pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:05:28.562062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Image pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:05:28.562709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:05:28.576867 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:28.578153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:28.579656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:28.581443 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:28.607280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Getting quotas for project 0d5c999358804f80929d210c54fe1fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:05:28.614111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Getting quotas for user 52adbfb830ce4351a1eca89f2e4392bb and project 0d5c999358804f80929d210c54fe1fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:05:28.630177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Going to run 1 instances... {{(pid=94298) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:05:28.633569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:05:28.736170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6c1561d5-b404-40ee-8ff6-5f5836dfd71c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.342946 Dec 21 04:05:28.745987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 108/254] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:05:16 2020] POST /compute/v2.1/servers => generated 380 bytes in 12354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:05:28.759058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a813f1d0-4033-43a5-9954-32cb76a0e4b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:28.764390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a813f1d0-4033-43a5-9954-32cb76a0e4b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:28.770272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-077a4d60-90c3-4cad-bb4c-1bea50eea34d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:28.776113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-077a4d60-90c3-4cad-bb4c-1bea50eea34d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:28.788644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a813f1d0-4033-43a5-9954-32cb76a0e4b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:28.795127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a813f1d0-4033-43a5-9954-32cb76a0e4b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:28.796199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a813f1d0-4033-43a5-9954-32cb76a0e4b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:28.796799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a813f1d0-4033-43a5-9954-32cb76a0e4b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:28.953117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-077a4d60-90c3-4cad-bb4c-1bea50eea34d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:28.978214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-077a4d60-90c3-4cad-bb4c-1bea50eea34d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1217 microversion: 2.1 time: 0.227552 Dec 21 04:05:28.979154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 109/255] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:28 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:29.013689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dbe2bccb-94fc-4058-a20b-d834cea65e28 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:29.017883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dbe2bccb-94fc-4058-a20b-d834cea65e28 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:29.051283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dbe2bccb-94fc-4058-a20b-d834cea65e28 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:29.051786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dbe2bccb-94fc-4058-a20b-d834cea65e28 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:29.052642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dbe2bccb-94fc-4058-a20b-d834cea65e28 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:29.053633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dbe2bccb-94fc-4058-a20b-d834cea65e28 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:29.406096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dbe2bccb-94fc-4058-a20b-d834cea65e28 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 27761 microversion: 2.1 time: 0.425304 Dec 21 04:05:29.406755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 110/256] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:28 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 27761 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:29.465182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-42c33dd1-7fb6-41da-9a85-9a61e41100c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:29.466945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-42c33dd1-7fb6-41da-9a85-9a61e41100c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:29.485813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-42c33dd1-7fb6-41da-9a85-9a61e41100c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:29.486582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-42c33dd1-7fb6-41da-9a85-9a61e41100c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:29.489564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-42c33dd1-7fb6-41da-9a85-9a61e41100c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:29.490293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-42c33dd1-7fb6-41da-9a85-9a61e41100c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:29.718747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-42c33dd1-7fb6-41da-9a85-9a61e41100c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 28438 microversion: 2.20 time: 0.310152 Dec 21 04:05:29.720369 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 111/257] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:29 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 28438 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:29.899298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a813f1d0-4033-43a5-9954-32cb76a0e4b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:29.909046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a813f1d0-4033-43a5-9954-32cb76a0e4b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 1.165724 Dec 21 04:05:29.909638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 147/258] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:28 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:05:30.019938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-54b794e7-589e-4fdb-9255-fa1cd1e828de tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:30.021214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-54b794e7-589e-4fdb-9255-fa1cd1e828de tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:30.034887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-54b794e7-589e-4fdb-9255-fa1cd1e828de tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:30.037334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-54b794e7-589e-4fdb-9255-fa1cd1e828de tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:30.038498 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-54b794e7-589e-4fdb-9255-fa1cd1e828de tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:30.039160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-54b794e7-589e-4fdb-9255-fa1cd1e828de tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:30.222156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-54b794e7-589e-4fdb-9255-fa1cd1e828de tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:30.232001 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-54b794e7-589e-4fdb-9255-fa1cd1e828de tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1213 microversion: 2.1 time: 0.238599 Dec 21 04:05:30.233426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 112/259] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:29 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1213 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:30.482892 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3db92605-b9e7-486f-a8c9-064458442b9d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:30.485862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3db92605-b9e7-486f-a8c9-064458442b9d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:30.560239 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3db92605-b9e7-486f-a8c9-064458442b9d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:30.563276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3db92605-b9e7-486f-a8c9-064458442b9d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:30.568965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3db92605-b9e7-486f-a8c9-064458442b9d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:30.571260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3db92605-b9e7-486f-a8c9-064458442b9d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:30.738679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-27189b41-7276-46cc-aa6a-be3de7fb719c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:30.743477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-27189b41-7276-46cc-aa6a-be3de7fb719c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:30.779326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-27189b41-7276-46cc-aa6a-be3de7fb719c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:30.781726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-27189b41-7276-46cc-aa6a-be3de7fb719c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:30.782837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-27189b41-7276-46cc-aa6a-be3de7fb719c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:30.783643 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-27189b41-7276-46cc-aa6a-be3de7fb719c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:30.885451 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3db92605-b9e7-486f-a8c9-064458442b9d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28063 microversion: 2.1 time: 0.470696 Dec 21 04:05:30.886742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 148/260] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:30 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28063 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:30.934499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-36e13e39-0557-4c39-9f54-7c4f90438bed tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:30.935504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-36e13e39-0557-4c39-9f54-7c4f90438bed tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:30.957261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-36e13e39-0557-4c39-9f54-7c4f90438bed tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:30.961879 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-36e13e39-0557-4c39-9f54-7c4f90438bed tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:30.963117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-36e13e39-0557-4c39-9f54-7c4f90438bed tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:30.963997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-36e13e39-0557-4c39-9f54-7c4f90438bed tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:31.018618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-27189b41-7276-46cc-aa6a-be3de7fb719c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 28602 microversion: 2.20 time: 0.290558 Dec 21 04:05:31.020061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 113/261] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:30 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 28602 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:31.260664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cbe9dced-510a-4b02-acb9-63e7847292c2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:31.261448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cbe9dced-510a-4b02-acb9-63e7847292c2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:31.272094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbe9dced-510a-4b02-acb9-63e7847292c2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:31.272929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbe9dced-510a-4b02-acb9-63e7847292c2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:31.274408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbe9dced-510a-4b02-acb9-63e7847292c2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:31.275198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbe9dced-510a-4b02-acb9-63e7847292c2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:32.002431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cbe9dced-510a-4b02-acb9-63e7847292c2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:32.025597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cbe9dced-510a-4b02-acb9-63e7847292c2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1287 microversion: 2.1 time: 0.777745 Dec 21 04:05:32.026199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 114/262] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:31 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1287 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:05:32.050170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c50e3dca-2564-45b7-85df-f6d63292d703 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:32.051617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c50e3dca-2564-45b7-85df-f6d63292d703 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:32.062356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c50e3dca-2564-45b7-85df-f6d63292d703 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:32.063049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c50e3dca-2564-45b7-85df-f6d63292d703 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:32.064302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c50e3dca-2564-45b7-85df-f6d63292d703 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:32.064935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c50e3dca-2564-45b7-85df-f6d63292d703 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:32.243370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c50e3dca-2564-45b7-85df-f6d63292d703 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28180 microversion: 2.1 time: 0.215677 Dec 21 04:05:32.244629 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 115/263] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:32 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28180 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:32.265992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8b4f151f-d12e-4a29-ab12-dc305ed4ed38 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:32.267224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8b4f151f-d12e-4a29-ab12-dc305ed4ed38 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:32.285967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8b4f151f-d12e-4a29-ab12-dc305ed4ed38 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:32.287515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8b4f151f-d12e-4a29-ab12-dc305ed4ed38 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:32.290798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8b4f151f-d12e-4a29-ab12-dc305ed4ed38 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:32.291899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8b4f151f-d12e-4a29-ab12-dc305ed4ed38 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:32.389876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-36e13e39-0557-4c39-9f54-7c4f90438bed tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:32.416656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-36e13e39-0557-4c39-9f54-7c4f90438bed tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1521 microversion: 2.1 time: 1.493055 Dec 21 04:05:32.417271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 149/264] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:30 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1521 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:32.536682 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8b4f151f-d12e-4a29-ab12-dc305ed4ed38 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 28604 microversion: 2.20 time: 0.290385 Dec 21 04:05:32.537905 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 116/265] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:32 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 28604 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:33.049241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e5d4c36c-308f-481f-8b0a-98c64d7e6021 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:33.049901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e5d4c36c-308f-481f-8b0a-98c64d7e6021 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:33.072122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5d4c36c-308f-481f-8b0a-98c64d7e6021 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:33.073532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5d4c36c-308f-481f-8b0a-98c64d7e6021 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:33.075604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5d4c36c-308f-481f-8b0a-98c64d7e6021 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:33.077548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5d4c36c-308f-481f-8b0a-98c64d7e6021 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:33.262854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-977699f0-9a73-42bc-81ab-e06df1a12fbe tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:33.264042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-977699f0-9a73-42bc-81ab-e06df1a12fbe tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:33.292777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-977699f0-9a73-42bc-81ab-e06df1a12fbe tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:33.308075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-977699f0-9a73-42bc-81ab-e06df1a12fbe tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:33.308962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-977699f0-9a73-42bc-81ab-e06df1a12fbe tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:33.309632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-977699f0-9a73-42bc-81ab-e06df1a12fbe tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:33.552382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-977699f0-9a73-42bc-81ab-e06df1a12fbe tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28180 microversion: 2.1 time: 0.300321 Dec 21 04:05:33.559605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 117/266] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:33 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28180 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:33.574679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-90cd8014-77a4-4ea9-973b-69b928a7739f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:33.583364 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-90cd8014-77a4-4ea9-973b-69b928a7739f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:33.603110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90cd8014-77a4-4ea9-973b-69b928a7739f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:33.607176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90cd8014-77a4-4ea9-973b-69b928a7739f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:33.617416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90cd8014-77a4-4ea9-973b-69b928a7739f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:33.618073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90cd8014-77a4-4ea9-973b-69b928a7739f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:34.456531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e5d4c36c-308f-481f-8b0a-98c64d7e6021 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:34.489705 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e5d4c36c-308f-481f-8b0a-98c64d7e6021 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1317 microversion: 2.1 time: 1.449619 Dec 21 04:05:34.495567 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 150/267] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:33 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1317 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:34.531528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cf6f9f29-a403-4c4f-8fb5-b30b9ccd43e1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:34.535540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cf6f9f29-a403-4c4f-8fb5-b30b9ccd43e1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:34.555005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cf6f9f29-a403-4c4f-8fb5-b30b9ccd43e1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:34.555750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cf6f9f29-a403-4c4f-8fb5-b30b9ccd43e1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:34.560233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cf6f9f29-a403-4c4f-8fb5-b30b9ccd43e1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:34.560934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cf6f9f29-a403-4c4f-8fb5-b30b9ccd43e1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:34.648230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-90cd8014-77a4-4ea9-973b-69b928a7739f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:34.679252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-90cd8014-77a4-4ea9-973b-69b928a7739f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1501 microversion: 2.1 time: 1.116954 Dec 21 04:05:34.679366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 118/268] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:33 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1501 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:34.698925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2e444f29-2c95-4f37-bd68-71bd4053691d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:34.710891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2e444f29-2c95-4f37-bd68-71bd4053691d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:34.713512 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cf6f9f29-a403-4c4f-8fb5-b30b9ccd43e1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 28604 microversion: 2.20 time: 0.207284 Dec 21 04:05:34.717869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 151/269] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:34 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 28604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:34.726244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d375b36b-b50e-4636-bb5b-b020e3331459 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:34.736420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e444f29-2c95-4f37-bd68-71bd4053691d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:34.738582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e444f29-2c95-4f37-bd68-71bd4053691d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:34.741455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e444f29-2c95-4f37-bd68-71bd4053691d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:34.750044 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d375b36b-b50e-4636-bb5b-b020e3331459 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:34.750934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e444f29-2c95-4f37-bd68-71bd4053691d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:34.778823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d375b36b-b50e-4636-bb5b-b020e3331459 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:34.779357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d375b36b-b50e-4636-bb5b-b020e3331459 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:34.780208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d375b36b-b50e-4636-bb5b-b020e3331459 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:34.780698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d375b36b-b50e-4636-bb5b-b020e3331459 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:35.043468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2e444f29-2c95-4f37-bd68-71bd4053691d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28180 microversion: 2.1 time: 0.362653 Dec 21 04:05:35.044147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 119/270] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:34 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28180 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:35.468084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d375b36b-b50e-4636-bb5b-b020e3331459 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:35.492148 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d375b36b-b50e-4636-bb5b-b020e3331459 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1516 microversion: 2.1 time: 0.775855 Dec 21 04:05:35.493269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 152/271] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:34 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1516 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:35.534183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e6d6d432-e917-4d3b-be6f-02e7b51d4338 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:35.534980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e6d6d432-e917-4d3b-be6f-02e7b51d4338 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:35.569247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6d6d432-e917-4d3b-be6f-02e7b51d4338 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:35.569756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6d6d432-e917-4d3b-be6f-02e7b51d4338 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:35.570626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6d6d432-e917-4d3b-be6f-02e7b51d4338 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:35.571161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6d6d432-e917-4d3b-be6f-02e7b51d4338 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:35.740917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2116500c-0254-465e-a8d6-379802f125ef tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:35.744315 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2116500c-0254-465e-a8d6-379802f125ef tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:35.768884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2116500c-0254-465e-a8d6-379802f125ef tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:35.770039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2116500c-0254-465e-a8d6-379802f125ef tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:35.771120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2116500c-0254-465e-a8d6-379802f125ef tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:35.775563 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2116500c-0254-465e-a8d6-379802f125ef tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:35.985427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2116500c-0254-465e-a8d6-379802f125ef tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 28604 microversion: 2.20 time: 0.261559 Dec 21 04:05:35.986411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 153/272] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:35 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 28604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:36.065773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-eb9d02b3-81c6-4188-bafa-219e9d0baae7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:36.071562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-eb9d02b3-81c6-4188-bafa-219e9d0baae7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:36.095902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eb9d02b3-81c6-4188-bafa-219e9d0baae7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:36.098761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eb9d02b3-81c6-4188-bafa-219e9d0baae7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:36.099847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eb9d02b3-81c6-4188-bafa-219e9d0baae7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:36.100931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eb9d02b3-81c6-4188-bafa-219e9d0baae7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:36.431759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-eb9d02b3-81c6-4188-bafa-219e9d0baae7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28471 microversion: 2.1 time: 0.380093 Dec 21 04:05:36.432505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 154/273] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:36 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 21 04:05:36.825553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e6d6d432-e917-4d3b-be6f-02e7b51d4338 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:36.872035 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-878bb626-18cb-45c6-9ae5-d52f5cfca5f2 req-3dd148c7-0f04-4de6-91e5-2dea2b2f5ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b779469-1f62-473f-adda-86fc33a0e8df", "tag": "6717ed8d-7c1e-4b4b-a666-05029d5a07ef"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:36.873809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e6d6d432-e917-4d3b-be6f-02e7b51d4338 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1317 microversion: 2.1 time: 1.358187 Dec 21 04:05:36.875157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 120/274] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:35 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1317 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:36.886789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:36.886789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:05:36.918137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-878bb626-18cb-45c6-9ae5-d52f5cfca5f2 req-3dd148c7-0f04-4de6-91e5-2dea2b2f5ff0 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:36.918577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-878bb626-18cb-45c6-9ae5-d52f5cfca5f2 req-3dd148c7-0f04-4de6-91e5-2dea2b2f5ff0 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:36.940409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-878bb626-18cb-45c6-9ae5-d52f5cfca5f2 req-3dd148c7-0f04-4de6-91e5-2dea2b2f5ff0 service nova] Creating event network-changed:6717ed8d-7c1e-4b4b-a666-05029d5a07ef for instance 5b779469-1f62-473f-adda-86fc33a0e8df on hv-cinder-73306 Dec 21 04:05:36.956700 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-878bb626-18cb-45c6-9ae5-d52f5cfca5f2 req-3dd148c7-0f04-4de6-91e5-2dea2b2f5ff0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097688 Dec 21 04:05:36.957794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 155/275] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:05:36 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:05:37.007827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b32c659b-2313-42e6-b42f-cfbeb527932f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:37.009124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b32c659b-2313-42e6-b42f-cfbeb527932f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:37.020199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b32c659b-2313-42e6-b42f-cfbeb527932f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:37.020951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b32c659b-2313-42e6-b42f-cfbeb527932f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:37.022634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b32c659b-2313-42e6-b42f-cfbeb527932f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:37.023533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b32c659b-2313-42e6-b42f-cfbeb527932f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:37.193561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b32c659b-2313-42e6-b42f-cfbeb527932f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 28604 microversion: 2.20 time: 0.198713 Dec 21 04:05:37.194429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 121/276] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:36 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 28604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:37.468544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-93aa8f38-04c5-4d39-8bff-f440ea49c982 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:37.469921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-93aa8f38-04c5-4d39-8bff-f440ea49c982 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:37.501887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93aa8f38-04c5-4d39-8bff-f440ea49c982 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:37.502399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93aa8f38-04c5-4d39-8bff-f440ea49c982 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:37.503306 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93aa8f38-04c5-4d39-8bff-f440ea49c982 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:37.503756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93aa8f38-04c5-4d39-8bff-f440ea49c982 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:37.765071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-21d6016f-468b-4067-b823-6473406a89ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Action: 'create', calling method: .version_select at 0x7f2bbd213378>, body: {"keypair": {"name": "tempest-TestShelveInstance-2008430900"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:37.819646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-21d6016f-468b-4067-b823-6473406a89ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Getting quotas for project b07ec805977d456b9447a634af514cde. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:05:37.824832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-21d6016f-468b-4067-b823-6473406a89ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Getting quotas for user b9ff84deff8a4f01911a9cec1145b5d9 and project b07ec805977d456b9447a634af514cde. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:05:38.226591 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-21d6016f-468b-4067-b823-6473406a89ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Getting quotas for project b07ec805977d456b9447a634af514cde. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:05:38.230813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-21d6016f-468b-4067-b823-6473406a89ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Getting quotas for user b9ff84deff8a4f01911a9cec1145b5d9 and project b07ec805977d456b9447a634af514cde. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:05:38.251246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-21d6016f-468b-4067-b823-6473406a89ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.889081 Dec 21 04:05:38.252942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 156/277] 10.222.0.16 () {60 vars in 1148 bytes} [Mon Dec 21 04:05:37 2020] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:38.265050 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-69244413-070b-48e6-8afe-46a6b7cae367 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:38.265808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-69244413-070b-48e6-8afe-46a6b7cae367 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:38.275115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69244413-070b-48e6-8afe-46a6b7cae367 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:38.275628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69244413-070b-48e6-8afe-46a6b7cae367 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:38.276469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69244413-070b-48e6-8afe-46a6b7cae367 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:38.277762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69244413-070b-48e6-8afe-46a6b7cae367 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:38.664830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-69244413-070b-48e6-8afe-46a6b7cae367 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:38.674100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-69244413-070b-48e6-8afe-46a6b7cae367 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1317 microversion: 2.1 time: 0.419339 Dec 21 04:05:38.675036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 157/278] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:38 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:38.684965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7f716042-a7de-45bb-a7b0-bb8beffbc8ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:38.686028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7f716042-a7de-45bb-a7b0-bb8beffbc8ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:38.695511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f716042-a7de-45bb-a7b0-bb8beffbc8ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:38.696161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f716042-a7de-45bb-a7b0-bb8beffbc8ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:38.696985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f716042-a7de-45bb-a7b0-bb8beffbc8ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:38.697502 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f716042-a7de-45bb-a7b0-bb8beffbc8ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:38.771941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-7f716042-a7de-45bb-a7b0-bb8beffbc8ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lazy-loading 'flavor' on Instance uuid 066ef53e-6421-4004-bd12-2e238a638cd1 {{(pid=94299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:05:38.944858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7f716042-a7de-45bb-a7b0-bb8beffbc8ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "POST /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/action" status: 200 len: 32 microversion: 2.1 time: 0.268471 Dec 21 04:05:38.945665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 158/279] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:38 2020] POST /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/action => generated 32 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:05:38.956994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-25e18773-c751-47ec-9104-a1bf09a9fa63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:38.958140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-25e18773-c751-47ec-9104-a1bf09a9fa63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:38.968175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-25e18773-c751-47ec-9104-a1bf09a9fa63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:38.968682 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-25e18773-c751-47ec-9104-a1bf09a9fa63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:38.969600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-25e18773-c751-47ec-9104-a1bf09a9fa63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:38.969971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-25e18773-c751-47ec-9104-a1bf09a9fa63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:40.285972 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-93aa8f38-04c5-4d39-8bff-f440ea49c982 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28471 microversion: 2.1 time: 2.845200 Dec 21 04:05:40.291522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 122/280] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:37 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28471 bytes in 2852 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:40.297015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-25e18773-c751-47ec-9104-a1bf09a9fa63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 28604 microversion: 2.20 time: 1.349519 Dec 21 04:05:40.298577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 159/281] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:38 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 28604 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:40.308515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d7775373-4324-41ce-90be-8f8cbf6273b6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Action: 'create', calling method: .version_select at 0x7f2bb877a9d8>, body: {"security_group": {"name": "tempest-TestShelveInstance-1443436908", "description": "tempest-TestShelveInstance-1443436908 description"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:40.343184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b03fd47d-34f3-4076-b1fc-5ac57b2566f9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:40.346208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b03fd47d-34f3-4076-b1fc-5ac57b2566f9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:40.369600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b03fd47d-34f3-4076-b1fc-5ac57b2566f9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:40.370363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b03fd47d-34f3-4076-b1fc-5ac57b2566f9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:40.371506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b03fd47d-34f3-4076-b1fc-5ac57b2566f9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:40.372135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b03fd47d-34f3-4076-b1fc-5ac57b2566f9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:40.674190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b03fd47d-34f3-4076-b1fc-5ac57b2566f9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:40.684899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b03fd47d-34f3-4076-b1fc-5ac57b2566f9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.385305 Dec 21 04:05:40.685788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 160/282] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:40 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:40.712360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-05bfd705-47cf-4b6c-8739-1d765bf3e85a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:40.713208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-05bfd705-47cf-4b6c-8739-1d765bf3e85a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:40.739145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-05bfd705-47cf-4b6c-8739-1d765bf3e85a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:40.740334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-05bfd705-47cf-4b6c-8739-1d765bf3e85a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:40.742521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-05bfd705-47cf-4b6c-8739-1d765bf3e85a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:40.743316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-05bfd705-47cf-4b6c-8739-1d765bf3e85a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:41.051128 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-05bfd705-47cf-4b6c-8739-1d765bf3e85a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:41.060656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-05bfd705-47cf-4b6c-8739-1d765bf3e85a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1317 microversion: 2.1 time: 0.373738 Dec 21 04:05:41.061474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 161/283] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:40 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:41.307254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-df2b058a-9f75-45ea-83bf-30641e65736a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:41.308473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-df2b058a-9f75-45ea-83bf-30641e65736a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:41.319618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df2b058a-9f75-45ea-83bf-30641e65736a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:41.320256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df2b058a-9f75-45ea-83bf-30641e65736a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:41.322473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df2b058a-9f75-45ea-83bf-30641e65736a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:41.323723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df2b058a-9f75-45ea-83bf-30641e65736a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:41.395639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d7775373-4324-41ce-90be-8f8cbf6273b6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.102547 Dec 21 04:05:41.399145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 123/284] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Dec 21 04:05:40 2020] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:05:41.411164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1ef8c942-333a-4a3b-ac32-d3f6f10936d7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:41.414215 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1ef8c942-333a-4a3b-ac32-d3f6f10936d7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:41.431427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ef8c942-333a-4a3b-ac32-d3f6f10936d7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:41.432285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ef8c942-333a-4a3b-ac32-d3f6f10936d7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:41.433337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ef8c942-333a-4a3b-ac32-d3f6f10936d7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:41.434186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ef8c942-333a-4a3b-ac32-d3f6f10936d7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:41.500192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-df2b058a-9f75-45ea-83bf-30641e65736a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28638 microversion: 2.1 time: 0.204426 Dec 21 04:05:41.503047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 162/285] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:41 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28638 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 21 04:05:41.542448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-22ac0144-0912-4195-88ec-7892a0c4a296 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Action: 'create', calling method: .version_select at 0x7f2bbd27bea0>, body: {"security_group_rule": {"parent_group_id": "c69f3a10-da00-4297-95de-3f1efe38de68", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:41.586278 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1ef8c942-333a-4a3b-ac32-d3f6f10936d7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 28604 microversion: 2.20 time: 0.184620 Dec 21 04:05:41.586818 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 124/286] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:41 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 28604 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:41.709762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d5bc684c-7e73-48c8-b1da-9fa0650bf1ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:41.710955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d5bc684c-7e73-48c8-b1da-9fa0650bf1ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:41.720688 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d5bc684c-7e73-48c8-b1da-9fa0650bf1ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:41.721495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d5bc684c-7e73-48c8-b1da-9fa0650bf1ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:41.722671 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d5bc684c-7e73-48c8-b1da-9fa0650bf1ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:41.723399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d5bc684c-7e73-48c8-b1da-9fa0650bf1ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:41.807767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-22ac0144-0912-4195-88ec-7892a0c4a296 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.297430 Dec 21 04:05:41.815679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 163/287] 10.222.0.16 () {60 vars in 1185 bytes} [Mon Dec 21 04:05:41 2020] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:05:41.829247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a0f7935b-a1b8-45a0-8eb5-ca7706cbca8f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Action: 'create', calling method: .version_select at 0x7f2bb84a0378>, body: {"security_group_rule": {"parent_group_id": "c69f3a10-da00-4297-95de-3f1efe38de68", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:42.183049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a0f7935b-a1b8-45a0-8eb5-ca7706cbca8f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.365603 Dec 21 04:05:42.183924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 164/288] 10.222.0.16 () {60 vars in 1185 bytes} [Mon Dec 21 04:05:41 2020] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:05:42.194436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3d25155b-3d55-42a3-81eb-761e82fad1c6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:42.195379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3d25155b-3d55-42a3-81eb-761e82fad1c6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:42.205382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d25155b-3d55-42a3-81eb-761e82fad1c6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:42.205893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d25155b-3d55-42a3-81eb-761e82fad1c6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:42.206739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d25155b-3d55-42a3-81eb-761e82fad1c6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:42.207307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d25155b-3d55-42a3-81eb-761e82fad1c6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:42.512440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3d25155b-3d55-42a3-81eb-761e82fad1c6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:42.524088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3d25155b-3d55-42a3-81eb-761e82fad1c6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1317 microversion: 2.1 time: 0.339237 Dec 21 04:05:42.535185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 165/289] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:42 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:42.547506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bf7b3cd3-2391-42e9-8d3c-4430f4a3efc7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:42.548670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bf7b3cd3-2391-42e9-8d3c-4430f4a3efc7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:42.558566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf7b3cd3-2391-42e9-8d3c-4430f4a3efc7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:42.559108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf7b3cd3-2391-42e9-8d3c-4430f4a3efc7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:42.559965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf7b3cd3-2391-42e9-8d3c-4430f4a3efc7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:42.560463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf7b3cd3-2391-42e9-8d3c-4430f4a3efc7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:42.791628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d5bc684c-7e73-48c8-b1da-9fa0650bf1ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:42.801502 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d5bc684c-7e73-48c8-b1da-9fa0650bf1ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 1.101941 Dec 21 04:05:42.813290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 125/290] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:41 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:05:42.824773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-857afadc-0314-481b-9484-d7b3367c2a37 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:42.826207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-857afadc-0314-481b-9484-d7b3367c2a37 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:42.836165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-857afadc-0314-481b-9484-d7b3367c2a37 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:42.837058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-857afadc-0314-481b-9484-d7b3367c2a37 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:42.838285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-857afadc-0314-481b-9484-d7b3367c2a37 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:42.838947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-857afadc-0314-481b-9484-d7b3367c2a37 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:43.039870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bf7b3cd3-2391-42e9-8d3c-4430f4a3efc7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28638 microversion: 2.1 time: 0.502882 Dec 21 04:05:43.040848 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 166/291] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:42 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28638 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:43.091748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-857afadc-0314-481b-9484-d7b3367c2a37 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 29815 microversion: 2.20 time: 0.276367 Dec 21 04:05:43.092637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 126/292] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:42 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 29815 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:43.172439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1618909389", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "networks": [{"uuid": "0cb38372-b1fe-404c-9646-e5579ec8fe7b"}]}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:43.261860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] validate_networks() for [('0cb38372-b1fe-404c-9646-e5579ec8fe7b', None, None, None)] {{(pid=94299) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:05:43.566765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-62fab81f-95eb-4d37-858c-369450c39711 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:43.569996 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-62fab81f-95eb-4d37-858c-369450c39711 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:43.588954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62fab81f-95eb-4d37-858c-369450c39711 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:43.602197 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62fab81f-95eb-4d37-858c-369450c39711 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:43.606929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62fab81f-95eb-4d37-858c-369450c39711 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:43.607963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62fab81f-95eb-4d37-858c-369450c39711 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:43.914480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-62fab81f-95eb-4d37-858c-369450c39711 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:43.933207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-62fab81f-95eb-4d37-858c-369450c39711 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1317 microversion: 2.1 time: 0.394204 Dec 21 04:05:43.939424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 127/293] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:43 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:43.961965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-687f2b42-a66b-48b3-bb8d-1a09937e8bd2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:43.962887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-687f2b42-a66b-48b3-bb8d-1a09937e8bd2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:43.982729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-687f2b42-a66b-48b3-bb8d-1a09937e8bd2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:43.985147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-687f2b42-a66b-48b3-bb8d-1a09937e8bd2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:43.987361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-687f2b42-a66b-48b3-bb8d-1a09937e8bd2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:43.988633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-687f2b42-a66b-48b3-bb8d-1a09937e8bd2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:44.107094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Flavor limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:05:44.107570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Image limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:05:44.108108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Flavor pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:05:44.108753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Image pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:05:44.109219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:05:44.121327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:44.122036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:44.123220 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:44.123966 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:44.150402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Getting quotas for project 13fc3096c5c34fe8b975ecce478f85fc. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:05:44.155954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Getting quotas for user 6f4617f0566845acb67b02c72c97856b and project 13fc3096c5c34fe8b975ecce478f85fc. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:05:44.172919 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Going to run 1 instances... {{(pid=94299) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:05:44.176906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:05:44.277900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5dc10f67-12d9-4978-ab34-7a1606c14cae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.117675 Dec 21 04:05:44.284444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 167/294] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:05:43 2020] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:05:44.295796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-8b0ca720-5cd7-450d-92d9-d4e61dbcbf9a req-7f0c613e-ce38-4140-ae2f-022d81cf0406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b779469-1f62-473f-adda-86fc33a0e8df", "name": "network-vif-plugged", "status": "completed", "tag": "6717ed8d-7c1e-4b4b-a666-05029d5a07ef"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:44.306426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:44.306426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:05:44.317804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-8b0ca720-5cd7-450d-92d9-d4e61dbcbf9a req-7f0c613e-ce38-4140-ae2f-022d81cf0406 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:44.318938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-8b0ca720-5cd7-450d-92d9-d4e61dbcbf9a req-7f0c613e-ce38-4140-ae2f-022d81cf0406 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:44.344313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-8b0ca720-5cd7-450d-92d9-d4e61dbcbf9a req-7f0c613e-ce38-4140-ae2f-022d81cf0406 service nova] Creating event network-vif-plugged:6717ed8d-7c1e-4b4b-a666-05029d5a07ef for instance 5b779469-1f62-473f-adda-86fc33a0e8df on hv-cinder-73306 Dec 21 04:05:44.350540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-8b0ca720-5cd7-450d-92d9-d4e61dbcbf9a req-7f0c613e-ce38-4140-ae2f-022d81cf0406 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067626 Dec 21 04:05:44.352031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 168/295] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:05:44 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:05:44.392020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e5181751-2add-465c-8288-292ff38a7955 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:44.393310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e5181751-2add-465c-8288-292ff38a7955 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:44.412135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5181751-2add-465c-8288-292ff38a7955 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:44.413865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5181751-2add-465c-8288-292ff38a7955 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:44.414893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5181751-2add-465c-8288-292ff38a7955 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:44.417171 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5181751-2add-465c-8288-292ff38a7955 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:44.823999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e5181751-2add-465c-8288-292ff38a7955 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28638 microversion: 2.1 time: 0.470692 Dec 21 04:05:44.824887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 169/296] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:44 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28638 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:44.844483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-58c04ee4-8cdd-4dc6-b3df-8c5fb5e695f7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:44.846046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-58c04ee4-8cdd-4dc6-b3df-8c5fb5e695f7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:44.852358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-687f2b42-a66b-48b3-bb8d-1a09937e8bd2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:44.858372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58c04ee4-8cdd-4dc6-b3df-8c5fb5e695f7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:44.859308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58c04ee4-8cdd-4dc6-b3df-8c5fb5e695f7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:44.860795 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58c04ee4-8cdd-4dc6-b3df-8c5fb5e695f7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:44.861958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58c04ee4-8cdd-4dc6-b3df-8c5fb5e695f7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:44.868776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-687f2b42-a66b-48b3-bb8d-1a09937e8bd2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.927884 Dec 21 04:05:44.869426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 128/297] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:43 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:44.892509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9491347e-8c84-4efe-8029-185ef0c5b0c2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:44.893193 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9491347e-8c84-4efe-8029-185ef0c5b0c2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:45.026803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-58c04ee4-8cdd-4dc6-b3df-8c5fb5e695f7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 33614 microversion: 2.20 time: 0.195399 Dec 21 04:05:45.028747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 170/298] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:44 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 33614 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:45.041540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9491347e-8c84-4efe-8029-185ef0c5b0c2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:45.043897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b3638f60-3ef9-4399-a562-5bd33c6c9d00 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:45.044718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b3638f60-3ef9-4399-a562-5bd33c6c9d00 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:45.052261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9491347e-8c84-4efe-8029-185ef0c5b0c2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1219 microversion: 2.1 time: 0.181724 Dec 21 04:05:45.053380 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 129/299] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:44 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1219 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:45.054245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3638f60-3ef9-4399-a562-5bd33c6c9d00 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:45.054744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3638f60-3ef9-4399-a562-5bd33c6c9d00 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:45.056561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3638f60-3ef9-4399-a562-5bd33c6c9d00 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:45.057080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3638f60-3ef9-4399-a562-5bd33c6c9d00 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:45.284097 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b3638f60-3ef9-4399-a562-5bd33c6c9d00 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:45.294271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b3638f60-3ef9-4399-a562-5bd33c6c9d00 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1317 microversion: 2.1 time: 0.264588 Dec 21 04:05:45.300814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 171/300] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:45 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:45.841838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ef044bd0-4dd0-48b9-87ae-122c66eca880 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:45.842867 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ef044bd0-4dd0-48b9-87ae-122c66eca880 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:45.861399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef044bd0-4dd0-48b9-87ae-122c66eca880 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:45.861912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef044bd0-4dd0-48b9-87ae-122c66eca880 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:45.862988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef044bd0-4dd0-48b9-87ae-122c66eca880 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:45.863485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef044bd0-4dd0-48b9-87ae-122c66eca880 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:45.892422 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fa2bd9cd-ac35-4df3-98e2-7b5822764d30 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:45.893085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fa2bd9cd-ac35-4df3-98e2-7b5822764d30 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:45.910787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fa2bd9cd-ac35-4df3-98e2-7b5822764d30 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:45.911361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fa2bd9cd-ac35-4df3-98e2-7b5822764d30 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:45.912912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fa2bd9cd-ac35-4df3-98e2-7b5822764d30 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:45.913403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fa2bd9cd-ac35-4df3-98e2-7b5822764d30 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:46.067743 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ef044bd0-4dd0-48b9-87ae-122c66eca880 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28638 microversion: 2.1 time: 0.235127 Dec 21 04:05:46.069256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 130/301] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:45 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28638 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:46.080997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1a7636c5-3c08-486c-8fc4-7c7055505690 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:46.082147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1a7636c5-3c08-486c-8fc4-7c7055505690 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:46.091487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a7636c5-3c08-486c-8fc4-7c7055505690 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:46.092335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a7636c5-3c08-486c-8fc4-7c7055505690 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:46.093389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a7636c5-3c08-486c-8fc4-7c7055505690 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:46.093853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a7636c5-3c08-486c-8fc4-7c7055505690 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:46.272248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1a7636c5-3c08-486c-8fc4-7c7055505690 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 34227 microversion: 2.20 time: 0.200933 Dec 21 04:05:46.273357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 131/302] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:46 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 34227 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:46.290381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-252893e4-496b-4f8a-b4d5-40fb8a9c6526 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:46.291515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-252893e4-496b-4f8a-b4d5-40fb8a9c6526 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:46.300722 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-252893e4-496b-4f8a-b4d5-40fb8a9c6526 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:46.301501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-252893e4-496b-4f8a-b4d5-40fb8a9c6526 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:46.303292 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-252893e4-496b-4f8a-b4d5-40fb8a9c6526 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:46.304230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-252893e4-496b-4f8a-b4d5-40fb8a9c6526 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:46.314934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fa2bd9cd-ac35-4df3-98e2-7b5822764d30 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:46.329771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fa2bd9cd-ac35-4df3-98e2-7b5822764d30 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.446215 Dec 21 04:05:46.344588 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 172/303] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:45 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:46.372464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b2e6a69f-af17-4829-a5cb-14d4762307cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:46.375903 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b2e6a69f-af17-4829-a5cb-14d4762307cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:46.402346 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b2e6a69f-af17-4829-a5cb-14d4762307cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:46.403064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b2e6a69f-af17-4829-a5cb-14d4762307cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:46.404209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b2e6a69f-af17-4829-a5cb-14d4762307cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:46.404782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b2e6a69f-af17-4829-a5cb-14d4762307cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:46.768410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-252893e4-496b-4f8a-b4d5-40fb8a9c6526 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:46.794437 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-252893e4-496b-4f8a-b4d5-40fb8a9c6526 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1289 microversion: 2.1 time: 0.519515 Dec 21 04:05:46.796660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 132/304] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:46 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1289 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:46.919227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b2e6a69f-af17-4829-a5cb-14d4762307cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:46.931453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b2e6a69f-af17-4829-a5cb-14d4762307cd tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1317 microversion: 2.1 time: 0.582262 Dec 21 04:05:46.932074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 173/305] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:46 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:47.087321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a0025e80-fb5d-491a-b443-e336484ce080 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:47.088688 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a0025e80-fb5d-491a-b443-e336484ce080 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:47.096962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0025e80-fb5d-491a-b443-e336484ce080 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:47.098196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0025e80-fb5d-491a-b443-e336484ce080 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:47.098526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0025e80-fb5d-491a-b443-e336484ce080 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:47.099910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0025e80-fb5d-491a-b443-e336484ce080 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:47.234241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a0025e80-fb5d-491a-b443-e336484ce080 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28638 microversion: 2.1 time: 0.157227 Dec 21 04:05:47.235726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 133/306] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:47 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28638 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:47.294236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b1916eeb-fc7b-45a4-8de3-dd74b84eb162 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:47.295260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b1916eeb-fc7b-45a4-8de3-dd74b84eb162 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:47.303857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1916eeb-fc7b-45a4-8de3-dd74b84eb162 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:47.304603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1916eeb-fc7b-45a4-8de3-dd74b84eb162 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:47.305425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1916eeb-fc7b-45a4-8de3-dd74b84eb162 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:47.306098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1916eeb-fc7b-45a4-8de3-dd74b84eb162 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:47.362551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c7efe513-6fbc-4e2d-9673-81b07b4c5344 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:47.364112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c7efe513-6fbc-4e2d-9673-81b07b4c5344 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:47.375120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7efe513-6fbc-4e2d-9673-81b07b4c5344 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:47.376290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7efe513-6fbc-4e2d-9673-81b07b4c5344 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:47.377353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7efe513-6fbc-4e2d-9673-81b07b4c5344 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:47.378045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7efe513-6fbc-4e2d-9673-81b07b4c5344 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:48.109575 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c7efe513-6fbc-4e2d-9673-81b07b4c5344 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:48.119379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c7efe513-6fbc-4e2d-9673-81b07b4c5344 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.769305 Dec 21 04:05:48.119976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 134/307] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:47 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:48.129640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f52f2e3d-621a-49ff-8731-2ef2997655c2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:48.130296 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f52f2e3d-621a-49ff-8731-2ef2997655c2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:48.138595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f52f2e3d-621a-49ff-8731-2ef2997655c2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:48.139169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f52f2e3d-621a-49ff-8731-2ef2997655c2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:48.140063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f52f2e3d-621a-49ff-8731-2ef2997655c2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:48.140556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f52f2e3d-621a-49ff-8731-2ef2997655c2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:48.719479 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f52f2e3d-621a-49ff-8731-2ef2997655c2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:48.729201 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f52f2e3d-621a-49ff-8731-2ef2997655c2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1319 microversion: 2.1 time: 0.608130 Dec 21 04:05:48.729801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 135/308] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:48 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1319 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:48.740765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3aa9cbe0-8260-411f-8b6d-8851109f5a67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:48.741430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3aa9cbe0-8260-411f-8b6d-8851109f5a67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:48.749126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3aa9cbe0-8260-411f-8b6d-8851109f5a67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:48.749636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3aa9cbe0-8260-411f-8b6d-8851109f5a67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:48.750475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3aa9cbe0-8260-411f-8b6d-8851109f5a67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:48.750997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3aa9cbe0-8260-411f-8b6d-8851109f5a67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:48.990637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3aa9cbe0-8260-411f-8b6d-8851109f5a67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:49.001003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3aa9cbe0-8260-411f-8b6d-8851109f5a67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1507 microversion: 2.1 time: 0.269223 Dec 21 04:05:49.002526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 136/309] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:48 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:49.015556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-efc63cf2-2db3-4a5e-9538-bed7403b7dd2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:49.016825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-efc63cf2-2db3-4a5e-9538-bed7403b7dd2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:49.026581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efc63cf2-2db3-4a5e-9538-bed7403b7dd2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:49.027621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efc63cf2-2db3-4a5e-9538-bed7403b7dd2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:49.028577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efc63cf2-2db3-4a5e-9538-bed7403b7dd2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:49.029168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efc63cf2-2db3-4a5e-9538-bed7403b7dd2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:50.429702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b1916eeb-fc7b-45a4-8de3-dd74b84eb162 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 36013 microversion: 2.20 time: 3.148926 Dec 21 04:05:50.430949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 174/310] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:47 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 36013 bytes in 3151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:50.433007 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-efc63cf2-2db3-4a5e-9538-bed7403b7dd2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28638 microversion: 2.1 time: 1.428717 Dec 21 04:05:50.433759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 137/311] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:49 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28638 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:50.447436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d917dd07-5a52-4ba9-b133-2c730164d550 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:50.448330 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d917dd07-5a52-4ba9-b133-2c730164d550 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:50.456853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d917dd07-5a52-4ba9-b133-2c730164d550 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:50.457462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d917dd07-5a52-4ba9-b133-2c730164d550 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:50.458393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d917dd07-5a52-4ba9-b133-2c730164d550 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:50.459202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d917dd07-5a52-4ba9-b133-2c730164d550 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:50.466964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8a0d2662-7770-40d2-b7ef-0a9d564746cd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:50.467802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8a0d2662-7770-40d2-b7ef-0a9d564746cd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:50.477012 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8a0d2662-7770-40d2-b7ef-0a9d564746cd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:50.477531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8a0d2662-7770-40d2-b7ef-0a9d564746cd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:50.478386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8a0d2662-7770-40d2-b7ef-0a9d564746cd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:50.478885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8a0d2662-7770-40d2-b7ef-0a9d564746cd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:50.712883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8a0d2662-7770-40d2-b7ef-0a9d564746cd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:50.721993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8a0d2662-7770-40d2-b7ef-0a9d564746cd tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.289461 Dec 21 04:05:50.722634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 175/312] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:50 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:50.971140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d917dd07-5a52-4ba9-b133-2c730164d550 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:50.980567 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d917dd07-5a52-4ba9-b133-2c730164d550 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1319 microversion: 2.1 time: 0.544691 Dec 21 04:05:50.981188 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 138/313] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:50 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1319 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:51.450974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e812bb14-b928-478f-88ec-33094fb12c69 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:51.458574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fc73d7ff-858e-40e0-afee-2273109ebb3d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:51.460300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fc73d7ff-858e-40e0-afee-2273109ebb3d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:51.464118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e812bb14-b928-478f-88ec-33094fb12c69 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:51.475187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e812bb14-b928-478f-88ec-33094fb12c69 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:51.475920 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e812bb14-b928-478f-88ec-33094fb12c69 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:51.476917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e812bb14-b928-478f-88ec-33094fb12c69 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:51.477589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e812bb14-b928-478f-88ec-33094fb12c69 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:51.477920 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc73d7ff-858e-40e0-afee-2273109ebb3d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:51.478579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc73d7ff-858e-40e0-afee-2273109ebb3d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:51.479587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc73d7ff-858e-40e0-afee-2273109ebb3d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:51.480094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc73d7ff-858e-40e0-afee-2273109ebb3d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:51.620025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e812bb14-b928-478f-88ec-33094fb12c69 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28638 microversion: 2.1 time: 0.178541 Dec 21 04:05:51.620791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 139/314] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:51 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28638 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:51.646752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fc73d7ff-858e-40e0-afee-2273109ebb3d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 36792 microversion: 2.20 time: 0.208696 Dec 21 04:05:51.651166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 176/315] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:51 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 36792 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:51.730599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-1d3ab15c-4a5c-4118-b7c9-3ab83bc9703b req-c5e46c79-5f33-46f6-8513-027ec98c485b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9c955c-eab7-4008-a9e4-75837f8cc0f4", "tag": "143f81ae-4663-43fe-a5c8-1eea68349715"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:51.737559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:51.737559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:05:51.747908 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-76090f70-a637-4731-b670-1629aac1837d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:51.748620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-76090f70-a637-4731-b670-1629aac1837d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:51.748744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-1d3ab15c-4a5c-4118-b7c9-3ab83bc9703b req-c5e46c79-5f33-46f6-8513-027ec98c485b service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:51.749282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-1d3ab15c-4a5c-4118-b7c9-3ab83bc9703b req-c5e46c79-5f33-46f6-8513-027ec98c485b service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:51.769928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76090f70-a637-4731-b670-1629aac1837d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:51.770796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76090f70-a637-4731-b670-1629aac1837d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:51.771645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76090f70-a637-4731-b670-1629aac1837d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:51.772169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76090f70-a637-4731-b670-1629aac1837d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:51.777508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-1d3ab15c-4a5c-4118-b7c9-3ab83bc9703b req-c5e46c79-5f33-46f6-8513-027ec98c485b service nova] Creating event network-changed:143f81ae-4663-43fe-a5c8-1eea68349715 for instance 5f9c955c-eab7-4008-a9e4-75837f8cc0f4 on hv-cinder-73306 Dec 21 04:05:51.782635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-1d3ab15c-4a5c-4118-b7c9-3ab83bc9703b req-c5e46c79-5f33-46f6-8513-027ec98c485b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062298 Dec 21 04:05:51.783392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 140/316] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:05:51 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:05:51.816678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0dcb3b8e-48a7-4bdf-bd49-a64e50f107d7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c928a2af-6c34-4346-b565-f91699877f8f"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:51.820133 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0dcb3b8e-48a7-4bdf-bd49-a64e50f107d7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:51.828935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0dcb3b8e-48a7-4bdf-bd49-a64e50f107d7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:51.829455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0dcb3b8e-48a7-4bdf-bd49-a64e50f107d7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:51.830318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0dcb3b8e-48a7-4bdf-bd49-a64e50f107d7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:51.830828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0dcb3b8e-48a7-4bdf-bd49-a64e50f107d7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:52.050006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-76090f70-a637-4731-b670-1629aac1837d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:52.059755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-76090f70-a637-4731-b670-1629aac1837d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.322770 Dec 21 04:05:52.060370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 177/317] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:51 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:52.078175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-506080648", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "networks": [{"uuid": "b2a3a343-ad64-49b0-b882-98a263ddf1dc"}]}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:52.160858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] validate_networks() for [('b2a3a343-ad64-49b0-b882-98a263ddf1dc', None, None, None)] {{(pid=94299) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:05:52.281973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0dcb3b8e-48a7-4bdf-bd49-a64e50f107d7 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "POST /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.475162 Dec 21 04:05:52.282649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 141/318] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Dec 21 04:05:51 2020] POST /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df/os-volume_attachments => generated 194 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:05:52.311135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-13b0c731-8bb4-41dd-8915-a6ec213393f2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:52.311952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-13b0c731-8bb4-41dd-8915-a6ec213393f2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:52.324139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-13b0c731-8bb4-41dd-8915-a6ec213393f2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:52.324649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-13b0c731-8bb4-41dd-8915-a6ec213393f2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:52.328447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-13b0c731-8bb4-41dd-8915-a6ec213393f2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:52.328955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-13b0c731-8bb4-41dd-8915-a6ec213393f2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:52.831165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Flavor limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:05:52.831648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Image limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:05:52.832152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Flavor pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:05:52.832749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Image pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:05:52.833228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:05:52.843402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:52.843916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:52.844792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:52.845296 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:52.864936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Getting quotas for project 012f21126d7d455391ef888198a0925c. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:05:52.869418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Getting quotas for user ce6a4d0576b74b53a97b6513edaa6ecf and project 012f21126d7d455391ef888198a0925c. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:05:52.881457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Going to run 1 instances... {{(pid=94299) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:05:52.884111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:05:52.934528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e9c43954-8b78-4a8a-a458-75d15ed757b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872916 Dec 21 04:05:52.935175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 178/319] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:05:52 2020] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:05:52.952710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-af502244-0f5d-488e-a9a4-921ac9fc80ee tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:52.953881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-af502244-0f5d-488e-a9a4-921ac9fc80ee tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:52.962488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af502244-0f5d-488e-a9a4-921ac9fc80ee tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:52.962992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af502244-0f5d-488e-a9a4-921ac9fc80ee tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:52.963837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af502244-0f5d-488e-a9a4-921ac9fc80ee tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:52.964327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af502244-0f5d-488e-a9a4-921ac9fc80ee tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:52.988391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-13b0c731-8bb4-41dd-8915-a6ec213393f2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:53.001467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-13b0c731-8bb4-41dd-8915-a6ec213393f2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1319 microversion: 2.1 time: 0.710781 Dec 21 04:05:53.002467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 142/320] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:52 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1319 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:53.015945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d8ad4aaa-b60f-4a4d-867f-2a036355ba8d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:53.017076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d8ad4aaa-b60f-4a4d-867f-2a036355ba8d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:53.036225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d8ad4aaa-b60f-4a4d-867f-2a036355ba8d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:53.037532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d8ad4aaa-b60f-4a4d-867f-2a036355ba8d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:53.038852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d8ad4aaa-b60f-4a4d-867f-2a036355ba8d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:53.039978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d8ad4aaa-b60f-4a4d-867f-2a036355ba8d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:53.106129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-af502244-0f5d-488e-a9a4-921ac9fc80ee tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28638 microversion: 2.1 time: 0.162550 Dec 21 04:05:53.106941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 179/321] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:52 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28638 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:53.121058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-162d3a88-0db8-4b6e-bf09-2ef73c324a38 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:53.122048 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-162d3a88-0db8-4b6e-bf09-2ef73c324a38 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:53.215717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d8ad4aaa-b60f-4a4d-867f-2a036355ba8d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 37577 microversion: 2.20 time: 0.210371 Dec 21 04:05:53.220032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 143/322] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:53 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 37577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:53.228878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-37b4b81a-7152-406d-8c79-c3ac3f7b768a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:53.229952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-37b4b81a-7152-406d-8c79-c3ac3f7b768a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:53.237570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-162d3a88-0db8-4b6e-bf09-2ef73c324a38 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:53.240159 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-37b4b81a-7152-406d-8c79-c3ac3f7b768a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:53.241137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-37b4b81a-7152-406d-8c79-c3ac3f7b768a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:53.241925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-37b4b81a-7152-406d-8c79-c3ac3f7b768a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:53.242947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-37b4b81a-7152-406d-8c79-c3ac3f7b768a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:53.247135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-162d3a88-0db8-4b6e-bf09-2ef73c324a38 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1213 microversion: 2.1 time: 0.138547 Dec 21 04:05:53.247922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 180/323] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:53 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:53.644084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-37b4b81a-7152-406d-8c79-c3ac3f7b768a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:53.653617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-37b4b81a-7152-406d-8c79-c3ac3f7b768a tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.435917 Dec 21 04:05:53.654198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 144/324] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:53 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:54.025651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-faad8343-a77f-4ffd-a083-f241795b4dff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:54.026320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-faad8343-a77f-4ffd-a083-f241795b4dff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:54.036276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-faad8343-a77f-4ffd-a083-f241795b4dff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:54.036276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-faad8343-a77f-4ffd-a083-f241795b4dff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:54.037120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-faad8343-a77f-4ffd-a083-f241795b4dff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:54.037679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-faad8343-a77f-4ffd-a083-f241795b4dff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:54.128503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b30ca6c9-73d8-4897-a1a0-d585e8170676 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:54.129581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b30ca6c9-73d8-4897-a1a0-d585e8170676 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:54.138530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b30ca6c9-73d8-4897-a1a0-d585e8170676 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:54.139066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b30ca6c9-73d8-4897-a1a0-d585e8170676 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:54.139900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b30ca6c9-73d8-4897-a1a0-d585e8170676 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:54.140465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b30ca6c9-73d8-4897-a1a0-d585e8170676 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:54.279528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b30ca6c9-73d8-4897-a1a0-d585e8170676 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 28638 microversion: 2.1 time: 0.164999 Dec 21 04:05:54.281283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 145/325] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:54 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 28638 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 21 04:05:54.294032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-faad8343-a77f-4ffd-a083-f241795b4dff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:54.294836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0c8f0584-5cc9-4dec-a567-f8246d2e68a4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:54.296307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0c8f0584-5cc9-4dec-a567-f8246d2e68a4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:54.303931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-faad8343-a77f-4ffd-a083-f241795b4dff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1319 microversion: 2.1 time: 0.287666 Dec 21 04:05:54.304500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 181/326] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:54 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:54.307157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0c8f0584-5cc9-4dec-a567-f8246d2e68a4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:54.307839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0c8f0584-5cc9-4dec-a567-f8246d2e68a4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:54.308834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0c8f0584-5cc9-4dec-a567-f8246d2e68a4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:54.309470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0c8f0584-5cc9-4dec-a567-f8246d2e68a4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:54.324436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f77e6949-c634-44ab-b43d-1a7d79702cec tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:54.325108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f77e6949-c634-44ab-b43d-1a7d79702cec tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:54.336201 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f77e6949-c634-44ab-b43d-1a7d79702cec tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:54.336735 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f77e6949-c634-44ab-b43d-1a7d79702cec tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:54.337654 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f77e6949-c634-44ab-b43d-1a7d79702cec tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:54.338151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f77e6949-c634-44ab-b43d-1a7d79702cec tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:54.461932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0c8f0584-5cc9-4dec-a567-f8246d2e68a4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 38066 microversion: 2.20 time: 0.178388 Dec 21 04:05:54.462634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 146/327] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:54 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 38066 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:54.498241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f77e6949-c634-44ab-b43d-1a7d79702cec tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:54.510356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f77e6949-c634-44ab-b43d-1a7d79702cec tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1283 microversion: 2.1 time: 0.197162 Dec 21 04:05:54.511352 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 182/328] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:54 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1283 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:54.680025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-61b8333c-b853-4b8a-b2e4-b97482e4c32d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:54.680808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-61b8333c-b853-4b8a-b2e4-b97482e4c32d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:54.690144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-61b8333c-b853-4b8a-b2e4-b97482e4c32d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:54.690262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-61b8333c-b853-4b8a-b2e4-b97482e4c32d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:54.691100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-61b8333c-b853-4b8a-b2e4-b97482e4c32d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:54.691600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-61b8333c-b853-4b8a-b2e4-b97482e4c32d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:55.110645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-61b8333c-b853-4b8a-b2e4-b97482e4c32d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:55.122711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-61b8333c-b853-4b8a-b2e4-b97482e4c32d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.453559 Dec 21 04:05:55.123343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 147/329] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:54 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:55.307709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bc9cb248-10cc-49f1-8a61-cb89eac9c967 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:55.308761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bc9cb248-10cc-49f1-8a61-cb89eac9c967 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:55.316587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc9cb248-10cc-49f1-8a61-cb89eac9c967 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:55.317378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc9cb248-10cc-49f1-8a61-cb89eac9c967 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:55.318627 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc9cb248-10cc-49f1-8a61-cb89eac9c967 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:55.319175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc9cb248-10cc-49f1-8a61-cb89eac9c967 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:55.327723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-691c7904-b08b-43e0-a423-d800b14ccf51 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:55.328397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-691c7904-b08b-43e0-a423-d800b14ccf51 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:55.346190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-691c7904-b08b-43e0-a423-d800b14ccf51 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:55.346703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-691c7904-b08b-43e0-a423-d800b14ccf51 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:55.347585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-691c7904-b08b-43e0-a423-d800b14ccf51 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:55.348086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-691c7904-b08b-43e0-a423-d800b14ccf51 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:55.480150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bc9cb248-10cc-49f1-8a61-cb89eac9c967 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 29959 microversion: 2.1 time: 0.190960 Dec 21 04:05:55.484384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 183/330] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:55 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 29959 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:55.493283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-81e81993-844c-4972-b22a-24af6d1cd5fa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:55.494479 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-81e81993-844c-4972-b22a-24af6d1cd5fa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:55.503014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81e81993-844c-4972-b22a-24af6d1cd5fa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:55.503532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81e81993-844c-4972-b22a-24af6d1cd5fa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:55.504380 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81e81993-844c-4972-b22a-24af6d1cd5fa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:55.504874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81e81993-844c-4972-b22a-24af6d1cd5fa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:55.654721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-81e81993-844c-4972-b22a-24af6d1cd5fa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 38066 microversion: 2.20 time: 0.171741 Dec 21 04:05:55.657134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 184/331] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:55 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 38066 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:55.669154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3297697a-7e84-49df-8dbb-0edc76af36a6 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:55.669690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3297697a-7e84-49df-8dbb-0edc76af36a6 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:55.678708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3297697a-7e84-49df-8dbb-0edc76af36a6 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:55.679235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3297697a-7e84-49df-8dbb-0edc76af36a6 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:55.680375 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3297697a-7e84-49df-8dbb-0edc76af36a6 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:55.680585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3297697a-7e84-49df-8dbb-0edc76af36a6 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:55.728530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-691c7904-b08b-43e0-a423-d800b14ccf51 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:55.739083 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-691c7904-b08b-43e0-a423-d800b14ccf51 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1319 microversion: 2.1 time: 0.421138 Dec 21 04:05:55.740454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 148/332] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:55 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:55.936427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3297697a-7e84-49df-8dbb-0edc76af36a6 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:55.945373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3297697a-7e84-49df-8dbb-0edc76af36a6 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1313 microversion: 2.1 time: 0.287545 Dec 21 04:05:55.946144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 185/333] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:55 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:56.147001 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c200dd95-31a2-4f0a-94fd-5096d8786daa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:56.147589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c200dd95-31a2-4f0a-94fd-5096d8786daa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:56.155379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c200dd95-31a2-4f0a-94fd-5096d8786daa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:56.155884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c200dd95-31a2-4f0a-94fd-5096d8786daa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:56.156709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c200dd95-31a2-4f0a-94fd-5096d8786daa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:56.157199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c200dd95-31a2-4f0a-94fd-5096d8786daa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:56.498620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ab925f42-9cc9-445d-8482-4de2b1377c73 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:56.501684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ab925f42-9cc9-445d-8482-4de2b1377c73 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:56.524448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ab925f42-9cc9-445d-8482-4de2b1377c73 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:56.524954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ab925f42-9cc9-445d-8482-4de2b1377c73 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:56.526017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ab925f42-9cc9-445d-8482-4de2b1377c73 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:56.526515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ab925f42-9cc9-445d-8482-4de2b1377c73 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:56.696010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ab925f42-9cc9-445d-8482-4de2b1377c73 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 31075 microversion: 2.1 time: 0.206496 Dec 21 04:05:56.700811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 186/334] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:56 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 31075 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:56.708057 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-64db41ae-bd0e-45de-a019-5f6908e00f5b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:56.709222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-64db41ae-bd0e-45de-a019-5f6908e00f5b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:56.718327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-64db41ae-bd0e-45de-a019-5f6908e00f5b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:56.718934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-64db41ae-bd0e-45de-a019-5f6908e00f5b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:56.719761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-64db41ae-bd0e-45de-a019-5f6908e00f5b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:56.720332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-64db41ae-bd0e-45de-a019-5f6908e00f5b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:56.850311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-64db41ae-bd0e-45de-a019-5f6908e00f5b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 38066 microversion: 2.20 time: 0.151479 Dec 21 04:05:56.851045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 187/335] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:56 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 38066 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:56.857500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c200dd95-31a2-4f0a-94fd-5096d8786daa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:56.861538 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-71aad6fb-6e6c-46d0-ae98-e304707de1cb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:56.862304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-71aad6fb-6e6c-46d0-ae98-e304707de1cb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:56.871469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-71aad6fb-6e6c-46d0-ae98-e304707de1cb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:56.871826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-71aad6fb-6e6c-46d0-ae98-e304707de1cb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:56.872667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-71aad6fb-6e6c-46d0-ae98-e304707de1cb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:56.873192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-71aad6fb-6e6c-46d0-ae98-e304707de1cb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:56.874356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c200dd95-31a2-4f0a-94fd-5096d8786daa tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.737049 Dec 21 04:05:56.885907 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 149/336] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:56 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:56.969170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7b316a33-82a2-435e-a627-da539ac35f30 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:56.970139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7b316a33-82a2-435e-a627-da539ac35f30 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:56.978699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b316a33-82a2-435e-a627-da539ac35f30 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:56.979235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b316a33-82a2-435e-a627-da539ac35f30 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:56.980216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b316a33-82a2-435e-a627-da539ac35f30 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:56.980706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b316a33-82a2-435e-a627-da539ac35f30 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:57.118512 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-71aad6fb-6e6c-46d0-ae98-e304707de1cb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:57.127293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-71aad6fb-6e6c-46d0-ae98-e304707de1cb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1319 microversion: 2.1 time: 0.275016 Dec 21 04:05:57.127896 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 188/337] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:56 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:57.409511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-6e13861e-ecf7-42c3-9120-f3ad8c76e83d req-49ed08c7-6fc9-4889-9e99-224b3342cd02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da035a33-faa9-433e-805f-0d351e6d42ed", "tag": "1f491f5c-823e-4db1-81ec-37a517ac94f3"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:57.416551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:57.416551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:05:57.425789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-6e13861e-ecf7-42c3-9120-f3ad8c76e83d req-49ed08c7-6fc9-4889-9e99-224b3342cd02 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:57.426278 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-6e13861e-ecf7-42c3-9120-f3ad8c76e83d req-49ed08c7-6fc9-4889-9e99-224b3342cd02 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:57.445777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-6e13861e-ecf7-42c3-9120-f3ad8c76e83d req-49ed08c7-6fc9-4889-9e99-224b3342cd02 service nova] Creating event network-changed:1f491f5c-823e-4db1-81ec-37a517ac94f3 for instance da035a33-faa9-433e-805f-0d351e6d42ed on hv-cinder-73306 Dec 21 04:05:57.450821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-6e13861e-ecf7-42c3-9120-f3ad8c76e83d req-49ed08c7-6fc9-4889-9e99-224b3342cd02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050335 Dec 21 04:05:57.451696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 189/338] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:05:57 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:05:57.502227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7b316a33-82a2-435e-a627-da539ac35f30 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:57.511850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7b316a33-82a2-435e-a627-da539ac35f30 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1313 microversion: 2.1 time: 0.551698 Dec 21 04:05:57.512458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 150/339] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:56 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1313 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:57.714891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5a57c2d7-fbf3-41e1-b62f-8480d612a610 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:57.716063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5a57c2d7-fbf3-41e1-b62f-8480d612a610 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:57.724865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a57c2d7-fbf3-41e1-b62f-8480d612a610 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:57.725416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a57c2d7-fbf3-41e1-b62f-8480d612a610 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:57.726257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a57c2d7-fbf3-41e1-b62f-8480d612a610 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:57.726790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a57c2d7-fbf3-41e1-b62f-8480d612a610 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:57.874443 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-214a00eb-6604-46a7-9980-4a79d24d5aa1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:57.875793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-214a00eb-6604-46a7-9980-4a79d24d5aa1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:57.894071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5a57c2d7-fbf3-41e1-b62f-8480d612a610 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 32171 microversion: 2.1 time: 0.185959 Dec 21 04:05:57.894071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 190/340] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:57 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 32171 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:57.894287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-214a00eb-6604-46a7-9980-4a79d24d5aa1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:57.894401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-214a00eb-6604-46a7-9980-4a79d24d5aa1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:57.895213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-214a00eb-6604-46a7-9980-4a79d24d5aa1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:57.904912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2a48b736-7199-4442-9d6d-b14dd49396b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:57.905852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2a48b736-7199-4442-9d6d-b14dd49396b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:57.908264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-214a00eb-6604-46a7-9980-4a79d24d5aa1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:57.927665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2a48b736-7199-4442-9d6d-b14dd49396b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:57.939433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2a48b736-7199-4442-9d6d-b14dd49396b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:57.940748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2a48b736-7199-4442-9d6d-b14dd49396b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:57.941555 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2a48b736-7199-4442-9d6d-b14dd49396b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:58.034704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-214a00eb-6604-46a7-9980-4a79d24d5aa1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 38066 microversion: 2.20 time: 0.175218 Dec 21 04:05:58.039992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 151/341] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:57 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 38066 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:05:58.151838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1a20bfd1-f0bf-47fc-98cf-cbbbcb3a9fd2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:58.153105 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1a20bfd1-f0bf-47fc-98cf-cbbbcb3a9fd2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:58.165086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a20bfd1-f0bf-47fc-98cf-cbbbcb3a9fd2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:58.165828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a20bfd1-f0bf-47fc-98cf-cbbbcb3a9fd2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:58.167307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a20bfd1-f0bf-47fc-98cf-cbbbcb3a9fd2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:58.167993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a20bfd1-f0bf-47fc-98cf-cbbbcb3a9fd2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:58.239595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2a48b736-7199-4442-9d6d-b14dd49396b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:58.250080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2a48b736-7199-4442-9d6d-b14dd49396b4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.357321 Dec 21 04:05:58.251764 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 191/342] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:57 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:58.263001 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-a54996fe-ee45-40b8-855f-ff49028a19e5 req-a3847cba-9fb8-4464-be52-a1d1910e7b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9c955c-eab7-4008-a9e4-75837f8cc0f4", "name": "network-vif-plugged", "status": "completed", "tag": "143f81ae-4663-43fe-a5c8-1eea68349715"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:58.270432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:58.270432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:05:58.280256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-a54996fe-ee45-40b8-855f-ff49028a19e5 req-a3847cba-9fb8-4464-be52-a1d1910e7b4a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:58.280762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-a54996fe-ee45-40b8-855f-ff49028a19e5 req-a3847cba-9fb8-4464-be52-a1d1910e7b4a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:58.299232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-a54996fe-ee45-40b8-855f-ff49028a19e5 req-a3847cba-9fb8-4464-be52-a1d1910e7b4a service nova] Creating event network-vif-plugged:143f81ae-4663-43fe-a5c8-1eea68349715 for instance 5f9c955c-eab7-4008-a9e4-75837f8cc0f4 on hv-cinder-73306 Dec 21 04:05:58.308655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-a54996fe-ee45-40b8-855f-ff49028a19e5 req-a3847cba-9fb8-4464-be52-a1d1910e7b4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055224 Dec 21 04:05:58.309619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 192/343] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:05:58 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:05:58.539900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7958b620-9252-4d3d-9b64-238c58241a77 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:58.540345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7958b620-9252-4d3d-9b64-238c58241a77 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:58.556230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7958b620-9252-4d3d-9b64-238c58241a77 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:58.556734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7958b620-9252-4d3d-9b64-238c58241a77 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:58.557589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7958b620-9252-4d3d-9b64-238c58241a77 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:58.558080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7958b620-9252-4d3d-9b64-238c58241a77 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:58.780697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1a20bfd1-f0bf-47fc-98cf-cbbbcb3a9fd2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:58.793433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1a20bfd1-f0bf-47fc-98cf-cbbbcb3a9fd2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1319 microversion: 2.1 time: 0.651862 Dec 21 04:05:58.794721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 152/344] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:58 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1319 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:05:58.853291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7958b620-9252-4d3d-9b64-238c58241a77 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:58.864331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7958b620-9252-4d3d-9b64-238c58241a77 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1313 microversion: 2.1 time: 0.338014 Dec 21 04:05:58.865282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 193/345] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:58 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:58.910834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d9cf3552-6f00-4bac-a174-eaeac860d5ff tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:58.913246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d9cf3552-6f00-4bac-a174-eaeac860d5ff tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:58.922691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d9cf3552-6f00-4bac-a174-eaeac860d5ff tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:58.923897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d9cf3552-6f00-4bac-a174-eaeac860d5ff tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:58.925385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d9cf3552-6f00-4bac-a174-eaeac860d5ff tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:58.926073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d9cf3552-6f00-4bac-a174-eaeac860d5ff tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:59.053851 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a7ddfa71-6f08-40f7-a995-29cddf1226b7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:05:59.055028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a7ddfa71-6f08-40f7-a995-29cddf1226b7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:59.063971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a7ddfa71-6f08-40f7-a995-29cddf1226b7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:59.064555 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a7ddfa71-6f08-40f7-a995-29cddf1226b7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:59.065453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a7ddfa71-6f08-40f7-a995-29cddf1226b7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:59.066015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a7ddfa71-6f08-40f7-a995-29cddf1226b7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:59.276029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d9cf3552-6f00-4bac-a174-eaeac860d5ff tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 32988 microversion: 2.1 time: 0.376821 Dec 21 04:05:59.277018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 153/346] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:05:58 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 32988 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:59.288862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c83c9225-fb45-4e21-8722-df25acc39c91 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:59.289686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c83c9225-fb45-4e21-8722-df25acc39c91 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:59.298342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c83c9225-fb45-4e21-8722-df25acc39c91 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:59.298858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c83c9225-fb45-4e21-8722-df25acc39c91 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:59.299914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c83c9225-fb45-4e21-8722-df25acc39c91 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:59.300411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c83c9225-fb45-4e21-8722-df25acc39c91 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:59.304793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a7ddfa71-6f08-40f7-a995-29cddf1226b7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 200 len: 38209 microversion: 2.20 time: 0.260507 Dec 21 04:05:59.306236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 194/347] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:05:59 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 38209 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 21 04:05:59.326013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bf583398-70c8-4158-a422-18e21e5669f2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:59.326774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bf583398-70c8-4158-a422-18e21e5669f2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:59.337447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf583398-70c8-4158-a422-18e21e5669f2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:59.338111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf583398-70c8-4158-a422-18e21e5669f2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:59.339131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf583398-70c8-4158-a422-18e21e5669f2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:59.340015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf583398-70c8-4158-a422-18e21e5669f2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:59.418848 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bf583398-70c8-4158-a422-18e21e5669f2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/ips" status: 200 len: 151 microversion: 2.20 time: 0.103165 Dec 21 04:05:59.419664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 195/348] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Dec 21 04:05:59 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/ips => generated 151 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:05:59.763219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c83c9225-fb45-4e21-8722-df25acc39c91 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:05:59.775520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c83c9225-fb45-4e21-8722-df25acc39c91 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.496846 Dec 21 04:05:59.776447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 154/349] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:59 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:05:59.825982 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2e8d4aac-4838-478c-8d1a-0cb0739db72d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:59.826768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2e8d4aac-4838-478c-8d1a-0cb0739db72d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:59.836895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e8d4aac-4838-478c-8d1a-0cb0739db72d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:59.837718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e8d4aac-4838-478c-8d1a-0cb0739db72d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:59.838765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e8d4aac-4838-478c-8d1a-0cb0739db72d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:59.839473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e8d4aac-4838-478c-8d1a-0cb0739db72d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:59.887434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2771ca76-5359-45da-9c27-6b3de0acabff tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:05:59.888357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2771ca76-5359-45da-9c27-6b3de0acabff tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:05:59.898182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2771ca76-5359-45da-9c27-6b3de0acabff tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:59.898856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2771ca76-5359-45da-9c27-6b3de0acabff tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:05:59.899965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2771ca76-5359-45da-9c27-6b3de0acabff tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:05:59.900870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2771ca76-5359-45da-9c27-6b3de0acabff tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:00.144836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2771ca76-5359-45da-9c27-6b3de0acabff tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:00.155459 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2771ca76-5359-45da-9c27-6b3de0acabff tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1313 microversion: 2.1 time: 0.277369 Dec 21 04:06:00.156257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 155/350] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:59 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:00.293776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bcd0823b-e09b-4ad5-9306-577d74cc2cef tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:00.295250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bcd0823b-e09b-4ad5-9306-577d74cc2cef tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:00.304601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bcd0823b-e09b-4ad5-9306-577d74cc2cef tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:00.305441 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bcd0823b-e09b-4ad5-9306-577d74cc2cef tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:00.306527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bcd0823b-e09b-4ad5-9306-577d74cc2cef tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:00.307249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bcd0823b-e09b-4ad5-9306-577d74cc2cef tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:00.378996 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2e8d4aac-4838-478c-8d1a-0cb0739db72d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:00.391580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2e8d4aac-4838-478c-8d1a-0cb0739db72d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1319 microversion: 2.1 time: 0.582860 Dec 21 04:06:00.392180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 196/351] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:05:59 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:00.476302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bcd0823b-e09b-4ad5-9306-577d74cc2cef tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 33172 microversion: 2.1 time: 0.192056 Dec 21 04:06:00.481911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 156/352] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:00 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 33172 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:06:00.799297 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3a226116-1537-4493-b275-d41c1e33e589 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:00.799835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3a226116-1537-4493-b275-d41c1e33e589 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:00.808332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a226116-1537-4493-b275-d41c1e33e589 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:00.808841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a226116-1537-4493-b275-d41c1e33e589 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:00.809678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a226116-1537-4493-b275-d41c1e33e589 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:00.810143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a226116-1537-4493-b275-d41c1e33e589 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:01.041812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3a226116-1537-4493-b275-d41c1e33e589 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:01.052236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3a226116-1537-4493-b275-d41c1e33e589 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.262034 Dec 21 04:06:01.052713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 197/353] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:00 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:01.180255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d713679e-6cdb-4e22-b5c1-b93c0cb31c48 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:01.181029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d713679e-6cdb-4e22-b5c1-b93c0cb31c48 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:01.189721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d713679e-6cdb-4e22-b5c1-b93c0cb31c48 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:01.190235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d713679e-6cdb-4e22-b5c1-b93c0cb31c48 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:01.191152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d713679e-6cdb-4e22-b5c1-b93c0cb31c48 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:01.191651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d713679e-6cdb-4e22-b5c1-b93c0cb31c48 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:01.414475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-84d598be-6e51-404b-b27f-66723cd5b69a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:01.415593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-84d598be-6e51-404b-b27f-66723cd5b69a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:01.423596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-84d598be-6e51-404b-b27f-66723cd5b69a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:01.424107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-84d598be-6e51-404b-b27f-66723cd5b69a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:01.424937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-84d598be-6e51-404b-b27f-66723cd5b69a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:01.425565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-84d598be-6e51-404b-b27f-66723cd5b69a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:01.426521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d713679e-6cdb-4e22-b5c1-b93c0cb31c48 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:01.435906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d713679e-6cdb-4e22-b5c1-b93c0cb31c48 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1313 microversion: 2.1 time: 0.265538 Dec 21 04:06:01.436586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 157/354] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:01 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:01.446698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-28faa645-4305-47db-87a8-6c1ef8db8f6d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c928a2af-6c34-4346-b565-f91699877f8f"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:01.448533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-28faa645-4305-47db-87a8-6c1ef8db8f6d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:01.456001 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-28faa645-4305-47db-87a8-6c1ef8db8f6d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:01.456511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-28faa645-4305-47db-87a8-6c1ef8db8f6d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:01.457358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-28faa645-4305-47db-87a8-6c1ef8db8f6d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:01.457856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-28faa645-4305-47db-87a8-6c1ef8db8f6d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:01.534327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-28faa645-4305-47db-87a8-6c1ef8db8f6d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] HTTP exception thrown: Invalid volume: volume c928a2af-6c34-4346-b565-f91699877f8f already attached Dec 21 04:06:01.535008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-28faa645-4305-47db-87a8-6c1ef8db8f6d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Returning 400 to user: Invalid volume: volume c928a2af-6c34-4346-b565-f91699877f8f already attached {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:06:01.535909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-28faa645-4305-47db-87a8-6c1ef8db8f6d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "POST /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df/os-volume_attachments" status: 400 len: 120 microversion: 2.1 time: 0.098300 Dec 21 04:06:01.537413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 158/355] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Dec 21 04:06:01 2020] POST /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df/os-volume_attachments => generated 120 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 21 04:06:01.547231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a4528ee9-e8b8-43b7-ad25-0c2ba6f75367 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:01.548273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a4528ee9-e8b8-43b7-ad25-0c2ba6f75367 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:01.556187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4528ee9-e8b8-43b7-ad25-0c2ba6f75367 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:01.556696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4528ee9-e8b8-43b7-ad25-0c2ba6f75367 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:01.557539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4528ee9-e8b8-43b7-ad25-0c2ba6f75367 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:01.558038 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4528ee9-e8b8-43b7-ad25-0c2ba6f75367 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:01.662372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-84d598be-6e51-404b-b27f-66723cd5b69a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:01.671125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-84d598be-6e51-404b-b27f-66723cd5b69a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1508 microversion: 2.1 time: 0.266430 Dec 21 04:06:01.671820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 198/356] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:01 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:01.682975 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f0fe72ad-3e10-4f91-a39f-16048a75f165 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:01.683537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f0fe72ad-3e10-4f91-a39f-16048a75f165 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:01.692020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0fe72ad-3e10-4f91-a39f-16048a75f165 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:01.692685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0fe72ad-3e10-4f91-a39f-16048a75f165 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:01.693676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0fe72ad-3e10-4f91-a39f-16048a75f165 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:01.694219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0fe72ad-3e10-4f91-a39f-16048a75f165 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:01.715806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a4528ee9-e8b8-43b7-ad25-0c2ba6f75367 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 33501 microversion: 2.1 time: 0.176966 Dec 21 04:06:01.718935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 159/357] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:01 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 33501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:06:02.061248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f0fe72ad-3e10-4f91-a39f-16048a75f165 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "DELETE /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df/os-volume_attachments/c928a2af-6c34-4346-b565-f91699877f8f" status: 202 len: 0 microversion: 2.1 time: 0.388067 Dec 21 04:06:02.062156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 199/358] 10.222.0.16 () {58 vars in 1406 bytes} [Mon Dec 21 04:06:01 2020] DELETE /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df/os-volume_attachments/c928a2af-6c34-4346-b565-f91699877f8f => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:06:02.080943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6f22027d-ca52-41ca-9ba0-2ffbf56940b2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:02.081806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6f22027d-ca52-41ca-9ba0-2ffbf56940b2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:02.092075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f22027d-ca52-41ca-9ba0-2ffbf56940b2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:02.092837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f22027d-ca52-41ca-9ba0-2ffbf56940b2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:02.094883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f22027d-ca52-41ca-9ba0-2ffbf56940b2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:02.095607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f22027d-ca52-41ca-9ba0-2ffbf56940b2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:02.207764 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8bc85f77-1599-4392-ad71-9ba4491142e5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:02.208718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8bc85f77-1599-4392-ad71-9ba4491142e5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:02.218388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8bc85f77-1599-4392-ad71-9ba4491142e5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:02.219137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8bc85f77-1599-4392-ad71-9ba4491142e5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:02.220166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8bc85f77-1599-4392-ad71-9ba4491142e5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:02.220842 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8bc85f77-1599-4392-ad71-9ba4491142e5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:02.307162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-8bc85f77-1599-4392-ad71-9ba4491142e5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lazy-loading 'flavor' on Instance uuid 37226a3f-240e-4e04-9813-fa3d109452de {{(pid=94299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:06:02.368118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6f22027d-ca52-41ca-9ba0-2ffbf56940b2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:02.379356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6f22027d-ca52-41ca-9ba0-2ffbf56940b2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.308853 Dec 21 04:06:02.380457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 160/359] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:02 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:02.459915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-796d9a5d-8342-4435-85e4-86f933dcf32f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:02.460592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-796d9a5d-8342-4435-85e4-86f933dcf32f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:02.479571 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-796d9a5d-8342-4435-85e4-86f933dcf32f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:02.480085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-796d9a5d-8342-4435-85e4-86f933dcf32f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:02.480948 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-796d9a5d-8342-4435-85e4-86f933dcf32f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:02.481444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-796d9a5d-8342-4435-85e4-86f933dcf32f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:02.759713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-796d9a5d-8342-4435-85e4-86f933dcf32f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:02.768752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-796d9a5d-8342-4435-85e4-86f933dcf32f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1313 microversion: 2.1 time: 0.318991 Dec 21 04:06:02.769500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 161/360] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:02 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:02.779987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ab34479f-218c-4141-8205-b07817d202f3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:02.781019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ab34479f-218c-4141-8205-b07817d202f3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:02.782014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8bc85f77-1599-4392-ad71-9ba4491142e5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 202 len: 0 microversion: 2.20 time: 0.583647 Dec 21 04:06:02.783293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 200/361] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:06:02 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:06:02.796651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ab34479f-218c-4141-8205-b07817d202f3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:02.797157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ab34479f-218c-4141-8205-b07817d202f3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:02.798009 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ab34479f-218c-4141-8205-b07817d202f3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:02.798341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e66886da-f5c3-4721-a69c-a2f10951f683 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:02.798556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ab34479f-218c-4141-8205-b07817d202f3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:02.799154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e66886da-f5c3-4721-a69c-a2f10951f683 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:02.808932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e66886da-f5c3-4721-a69c-a2f10951f683 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:02.809448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e66886da-f5c3-4721-a69c-a2f10951f683 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:02.810293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e66886da-f5c3-4721-a69c-a2f10951f683 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:02.810793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e66886da-f5c3-4721-a69c-a2f10951f683 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:03.020259 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ab34479f-218c-4141-8205-b07817d202f3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 34023 microversion: 2.1 time: 0.249538 Dec 21 04:06:03.021598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 162/362] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:02 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 34023 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:06:03.063909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e66886da-f5c3-4721-a69c-a2f10951f683 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:03.083617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e66886da-f5c3-4721-a69c-a2f10951f683 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:03.090351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e66886da-f5c3-4721-a69c-a2f10951f683 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:03.092151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e66886da-f5c3-4721-a69c-a2f10951f683 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.303772 Dec 21 04:06:03.092748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 201/363] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:02 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:06:03.403703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7bbbc53b-fa59-4e47-941f-98807b51988c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:03.404465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7bbbc53b-fa59-4e47-941f-98807b51988c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:03.413543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7bbbc53b-fa59-4e47-941f-98807b51988c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:03.414047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7bbbc53b-fa59-4e47-941f-98807b51988c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:03.414877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7bbbc53b-fa59-4e47-941f-98807b51988c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:03.415392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7bbbc53b-fa59-4e47-941f-98807b51988c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:03.642568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7bbbc53b-fa59-4e47-941f-98807b51988c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:03.652399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7bbbc53b-fa59-4e47-941f-98807b51988c tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1502 microversion: 2.1 time: 0.258547 Dec 21 04:06:03.653154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 163/364] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:03 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1502 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:03.675427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f39096c6-0b1c-4c90-8cb2-24c7e9a02186 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a23e308c-5a0c-450b-8782-798411f1e2c1"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:03.677090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f39096c6-0b1c-4c90-8cb2-24c7e9a02186 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:03.685386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f39096c6-0b1c-4c90-8cb2-24c7e9a02186 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:03.685900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f39096c6-0b1c-4c90-8cb2-24c7e9a02186 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:03.686742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f39096c6-0b1c-4c90-8cb2-24c7e9a02186 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:03.687263 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f39096c6-0b1c-4c90-8cb2-24c7e9a02186 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:03.758060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-f39096c6-0b1c-4c90-8cb2-24c7e9a02186 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] HTTP exception thrown: Cannot 'attach_volume' instance 066ef53e-6421-4004-bd12-2e238a638cd1 while it is in vm_state rescued Dec 21 04:06:03.758730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f39096c6-0b1c-4c90-8cb2-24c7e9a02186 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Returning 409 to user: Cannot 'attach_volume' instance 066ef53e-6421-4004-bd12-2e238a638cd1 while it is in vm_state rescued {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:06:03.759653 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f39096c6-0b1c-4c90-8cb2-24c7e9a02186 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "POST /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.093569 Dec 21 04:06:03.760264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 202/365] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Dec 21 04:06:03 2020] POST /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/os-volume_attachments => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 21 04:06:03.775197 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a9ff6a2f-899a-43b4-bb40-cab1dc493ef2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:03.775784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a9ff6a2f-899a-43b4-bb40-cab1dc493ef2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:03.783606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a9ff6a2f-899a-43b4-bb40-cab1dc493ef2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:03.784225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a9ff6a2f-899a-43b4-bb40-cab1dc493ef2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:03.785006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a9ff6a2f-899a-43b4-bb40-cab1dc493ef2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:03.785495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a9ff6a2f-899a-43b4-bb40-cab1dc493ef2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:03.795465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8affa93a-dd88-44ab-90d5-52efd31fa486 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:03.796181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8affa93a-dd88-44ab-90d5-52efd31fa486 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:03.805047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8affa93a-dd88-44ab-90d5-52efd31fa486 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:03.805566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8affa93a-dd88-44ab-90d5-52efd31fa486 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:03.806430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8affa93a-dd88-44ab-90d5-52efd31fa486 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:03.806965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8affa93a-dd88-44ab-90d5-52efd31fa486 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:04.032321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8affa93a-dd88-44ab-90d5-52efd31fa486 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:04.042172 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8affa93a-dd88-44ab-90d5-52efd31fa486 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1313 microversion: 2.1 time: 0.256841 Dec 21 04:06:04.042955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 203/366] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:03 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:04.054006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e11b4cdc-a361-46e0-80f5-95cd4219ed58 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:04.055174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e11b4cdc-a361-46e0-80f5-95cd4219ed58 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:04.063315 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e11b4cdc-a361-46e0-80f5-95cd4219ed58 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:04.063823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e11b4cdc-a361-46e0-80f5-95cd4219ed58 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:04.064663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e11b4cdc-a361-46e0-80f5-95cd4219ed58 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:04.065144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e11b4cdc-a361-46e0-80f5-95cd4219ed58 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:04.071749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a9ff6a2f-899a-43b4-bb40-cab1dc493ef2 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "POST /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/action" status: 202 len: 0 microversion: 2.1 time: 0.303713 Dec 21 04:06:04.071749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 164/367] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:03 2020] POST /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 21 04:06:04.086282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3a74fcd1-d43b-4686-8bde-e35bb36f7848 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:04.087392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3a74fcd1-d43b-4686-8bde-e35bb36f7848 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:04.097325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a74fcd1-d43b-4686-8bde-e35bb36f7848 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:04.098148 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a74fcd1-d43b-4686-8bde-e35bb36f7848 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:04.099733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a74fcd1-d43b-4686-8bde-e35bb36f7848 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:04.100963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a74fcd1-d43b-4686-8bde-e35bb36f7848 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:04.277916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e11b4cdc-a361-46e0-80f5-95cd4219ed58 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 34769 microversion: 2.1 time: 0.233588 Dec 21 04:06:04.279526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 204/368] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:04 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 34769 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:06:04.294219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-921b1114-a52b-4277-8668-5f983136a21e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:04.295022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-921b1114-a52b-4277-8668-5f983136a21e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:04.304604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-921b1114-a52b-4277-8668-5f983136a21e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:04.305102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-921b1114-a52b-4277-8668-5f983136a21e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:04.305917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-921b1114-a52b-4277-8668-5f983136a21e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:04.306412 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-921b1114-a52b-4277-8668-5f983136a21e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:04.577108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-921b1114-a52b-4277-8668-5f983136a21e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:04.595820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-921b1114-a52b-4277-8668-5f983136a21e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:04.605586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-921b1114-a52b-4277-8668-5f983136a21e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:04.606176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-921b1114-a52b-4277-8668-5f983136a21e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.325847 Dec 21 04:06:04.606789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 205/369] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:04 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:04.722106 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3a74fcd1-d43b-4686-8bde-e35bb36f7848 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:04.739005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3a74fcd1-d43b-4686-8bde-e35bb36f7848 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1510 microversion: 2.1 time: 0.663539 Dec 21 04:06:04.752633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 165/370] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:04 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1510 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:04.812198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1356563361", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "networks": [{"uuid": "cbe98613-5022-44ed-8fff-023841696a00"}]}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:04.903107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-684deffc-9d2a-4274-8b70-789133f66be5 req-91ff1a53-11c3-411e-a8e2-0ebdfb098ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da035a33-faa9-433e-805f-0d351e6d42ed", "name": "network-vif-plugged", "status": "completed", "tag": "1f491f5c-823e-4db1-81ec-37a517ac94f3"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:04.912310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] validate_networks() for [('cbe98613-5022-44ed-8fff-023841696a00', None, None, None)] {{(pid=94299) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:06:04.919986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:04.919986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:04.939928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-684deffc-9d2a-4274-8b70-789133f66be5 req-91ff1a53-11c3-411e-a8e2-0ebdfb098ec2 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:04.940531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-684deffc-9d2a-4274-8b70-789133f66be5 req-91ff1a53-11c3-411e-a8e2-0ebdfb098ec2 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:04.959127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-684deffc-9d2a-4274-8b70-789133f66be5 req-91ff1a53-11c3-411e-a8e2-0ebdfb098ec2 service nova] Creating event network-vif-plugged:1f491f5c-823e-4db1-81ec-37a517ac94f3 for instance da035a33-faa9-433e-805f-0d351e6d42ed on hv-cinder-73306 Dec 21 04:06:04.964316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-684deffc-9d2a-4274-8b70-789133f66be5 req-91ff1a53-11c3-411e-a8e2-0ebdfb098ec2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071225 Dec 21 04:06:04.965252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 166/371] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:04 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:06:05.068330 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ef34bb38-e156-4c35-b2d7-1166be7d5005 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:05.069795 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ef34bb38-e156-4c35-b2d7-1166be7d5005 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:05.078199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef34bb38-e156-4c35-b2d7-1166be7d5005 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:05.078933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef34bb38-e156-4c35-b2d7-1166be7d5005 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:05.080058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef34bb38-e156-4c35-b2d7-1166be7d5005 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:05.082260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef34bb38-e156-4c35-b2d7-1166be7d5005 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:05.539830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Flavor limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:06:05.540307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Image limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:06:05.540845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Flavor pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:06:05.541301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Image pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:06:05.541762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:06:05.550636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:05.551168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:05.552841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:05.553336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:05.572168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Getting quotas for project 0d5c999358804f80929d210c54fe1fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:06:05.576464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Getting quotas for user 52adbfb830ce4351a1eca89f2e4392bb and project 0d5c999358804f80929d210c54fe1fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:06:05.589490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Going to run 1 instances... {{(pid=94299) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:06:05.592550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:06:05.610747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ef34bb38-e156-4c35-b2d7-1166be7d5005 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:05.620419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ef34bb38-e156-4c35-b2d7-1166be7d5005 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1313 microversion: 2.1 time: 0.562682 Dec 21 04:06:05.621004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 167/372] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:05 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:05.630732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-430ef207-ed1b-4ed8-adcd-d9f1d0e08306 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:05.631787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-430ef207-ed1b-4ed8-adcd-d9f1d0e08306 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:05.639414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-430ef207-ed1b-4ed8-adcd-d9f1d0e08306 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:05.639966 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-430ef207-ed1b-4ed8-adcd-d9f1d0e08306 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:05.640786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-430ef207-ed1b-4ed8-adcd-d9f1d0e08306 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:05.641274 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-430ef207-ed1b-4ed8-adcd-d9f1d0e08306 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:05.645759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f64386ed-6bd8-4ed7-a364-83c6752f498c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842993 Dec 21 04:06:05.652107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 206/373] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:06:04 2020] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:06:05.668117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-be97c334-31c9-459e-975c-cd899506d8d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:05.668926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-be97c334-31c9-459e-975c-cd899506d8d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:05.678622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be97c334-31c9-459e-975c-cd899506d8d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:05.679316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be97c334-31c9-459e-975c-cd899506d8d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:05.680014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be97c334-31c9-459e-975c-cd899506d8d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:05.680515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be97c334-31c9-459e-975c-cd899506d8d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:05.906626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-430ef207-ed1b-4ed8-adcd-d9f1d0e08306 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 35502 microversion: 2.1 time: 0.283596 Dec 21 04:06:05.907949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 168/374] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:05 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 35502 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:06:05.922557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-be97c334-31c9-459e-975c-cd899506d8d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:05.928245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-544e3d81-2658-4917-9451-70cd9160729d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:05.934489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-544e3d81-2658-4917-9451-70cd9160729d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:05.945066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-be97c334-31c9-459e-975c-cd899506d8d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:05.952351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-be97c334-31c9-459e-975c-cd899506d8d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:05.953593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-be97c334-31c9-459e-975c-cd899506d8d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.305979 Dec 21 04:06:05.954527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 207/375] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:05 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:05.967912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dcfbf4cd-d895-4fad-8c8a-0f56be9a8864 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:05.968719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dcfbf4cd-d895-4fad-8c8a-0f56be9a8864 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:05.978303 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dcfbf4cd-d895-4fad-8c8a-0f56be9a8864 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:05.978885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dcfbf4cd-d895-4fad-8c8a-0f56be9a8864 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:05.979889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dcfbf4cd-d895-4fad-8c8a-0f56be9a8864 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:05.980393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dcfbf4cd-d895-4fad-8c8a-0f56be9a8864 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:06.033142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-544e3d81-2658-4917-9451-70cd9160729d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:06.043995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-544e3d81-2658-4917-9451-70cd9160729d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1218 microversion: 2.1 time: 0.134117 Dec 21 04:06:06.044882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 169/376] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:05 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:06.244483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dcfbf4cd-d895-4fad-8c8a-0f56be9a8864 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:06.253804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dcfbf4cd-d895-4fad-8c8a-0f56be9a8864 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1510 microversion: 2.1 time: 0.298090 Dec 21 04:06:06.254401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 208/377] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:05 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:06.642763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-58ea50e7-6a39-4dd6-871b-3c5c4da9f5b4 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:06.643501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-58ea50e7-6a39-4dd6-871b-3c5c4da9f5b4 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:06.652358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58ea50e7-6a39-4dd6-871b-3c5c4da9f5b4 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:06.652868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58ea50e7-6a39-4dd6-871b-3c5c4da9f5b4 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:06.653696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58ea50e7-6a39-4dd6-871b-3c5c4da9f5b4 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:06.654200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58ea50e7-6a39-4dd6-871b-3c5c4da9f5b4 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:06.873782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-58ea50e7-6a39-4dd6-871b-3c5c4da9f5b4 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:06.882748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-58ea50e7-6a39-4dd6-871b-3c5c4da9f5b4 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1313 microversion: 2.1 time: 0.248919 Dec 21 04:06:06.883372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 170/378] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:06 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:06.925546 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-52a9a0be-43dd-485c-bde7-855ce68652e7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:06.926688 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-52a9a0be-43dd-485c-bde7-855ce68652e7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:06.934652 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-52a9a0be-43dd-485c-bde7-855ce68652e7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:06.935190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-52a9a0be-43dd-485c-bde7-855ce68652e7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:06.936008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-52a9a0be-43dd-485c-bde7-855ce68652e7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:06.936499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-52a9a0be-43dd-485c-bde7-855ce68652e7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:06.984124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f1775507-bec5-4970-a300-9d321d21cba1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:06.984737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f1775507-bec5-4970-a300-9d321d21cba1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:06.995084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f1775507-bec5-4970-a300-9d321d21cba1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:06.995604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f1775507-bec5-4970-a300-9d321d21cba1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:06.996488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f1775507-bec5-4970-a300-9d321d21cba1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:06.996983 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f1775507-bec5-4970-a300-9d321d21cba1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:07.162438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-52a9a0be-43dd-485c-bde7-855ce68652e7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 35825 microversion: 2.1 time: 0.245809 Dec 21 04:06:07.163527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 209/379] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:06 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 35825 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:06:07.175391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e4270afe-212c-4626-948a-d8ca3cb83aad tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:07.176406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e4270afe-212c-4626-948a-d8ca3cb83aad tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:07.186591 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4270afe-212c-4626-948a-d8ca3cb83aad tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:07.187249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4270afe-212c-4626-948a-d8ca3cb83aad tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:07.188260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4270afe-212c-4626-948a-d8ca3cb83aad tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:07.188877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4270afe-212c-4626-948a-d8ca3cb83aad tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:07.236532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f1775507-bec5-4970-a300-9d321d21cba1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:07.263863 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f1775507-bec5-4970-a300-9d321d21cba1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:07.282946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f1775507-bec5-4970-a300-9d321d21cba1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:07.284190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f1775507-bec5-4970-a300-9d321d21cba1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.310834 Dec 21 04:06:07.294478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 171/380] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:06 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:07.305673 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-39b976f1-bcff-4f46-a923-bae558a66ef6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:07.306346 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-39b976f1-bcff-4f46-a923-bae558a66ef6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:07.335253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-39b976f1-bcff-4f46-a923-bae558a66ef6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:07.335678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-39b976f1-bcff-4f46-a923-bae558a66ef6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:07.336540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-39b976f1-bcff-4f46-a923-bae558a66ef6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:07.337038 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-39b976f1-bcff-4f46-a923-bae558a66ef6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:07.362855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e4270afe-212c-4626-948a-d8ca3cb83aad tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:07.374796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e4270afe-212c-4626-948a-d8ca3cb83aad tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1270 microversion: 2.1 time: 0.209594 Dec 21 04:06:07.376222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 210/381] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:07 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1270 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:07.809412 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-39b976f1-bcff-4f46-a923-bae558a66ef6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:07.825108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-39b976f1-bcff-4f46-a923-bae558a66ef6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1510 microversion: 2.1 time: 0.529389 Dec 21 04:06:07.825812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 172/382] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:07 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1510 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:07.930164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c1dcbdf5-b854-4ba9-b642-7546664ca8b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:07.931311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c1dcbdf5-b854-4ba9-b642-7546664ca8b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:07.939903 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1dcbdf5-b854-4ba9-b642-7546664ca8b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:07.940995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1dcbdf5-b854-4ba9-b642-7546664ca8b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:07.942252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1dcbdf5-b854-4ba9-b642-7546664ca8b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:07.942977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1dcbdf5-b854-4ba9-b642-7546664ca8b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:08.172837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c1dcbdf5-b854-4ba9-b642-7546664ca8b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:08.180344 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-69f503cd-c653-4ef7-ac98-bb90d1649dcd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:08.181739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-69f503cd-c653-4ef7-ac98-bb90d1649dcd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:08.182724 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c1dcbdf5-b854-4ba9-b642-7546664ca8b2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1496 microversion: 2.1 time: 0.285674 Dec 21 04:06:08.190041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69f503cd-c653-4ef7-ac98-bb90d1649dcd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:08.190798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69f503cd-c653-4ef7-ac98-bb90d1649dcd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:08.191875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69f503cd-c653-4ef7-ac98-bb90d1649dcd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:08.193222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69f503cd-c653-4ef7-ac98-bb90d1649dcd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:08.206592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 211/383] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:07 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1496 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:08.313951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2cdc5e54-70a9-424a-846c-9388fdc972c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:08.314791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2cdc5e54-70a9-424a-846c-9388fdc972c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:08.324820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2cdc5e54-70a9-424a-846c-9388fdc972c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:08.325415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2cdc5e54-70a9-424a-846c-9388fdc972c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:08.326335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2cdc5e54-70a9-424a-846c-9388fdc972c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:08.326894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2cdc5e54-70a9-424a-846c-9388fdc972c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:08.386342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-69f503cd-c653-4ef7-ac98-bb90d1649dcd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 36435 microversion: 2.1 time: 0.215323 Dec 21 04:06:08.387568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 173/384] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:08 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 36435 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:06:08.401793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-daf77569-d5f5-4daa-848f-2ff0cdda4867 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:08.402834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-daf77569-d5f5-4daa-848f-2ff0cdda4867 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:08.412263 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-daf77569-d5f5-4daa-848f-2ff0cdda4867 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:08.413011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-daf77569-d5f5-4daa-848f-2ff0cdda4867 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:08.413858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-daf77569-d5f5-4daa-848f-2ff0cdda4867 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:08.414353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-daf77569-d5f5-4daa-848f-2ff0cdda4867 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:08.580330 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-daf77569-d5f5-4daa-848f-2ff0cdda4867 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:08.591203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-daf77569-d5f5-4daa-848f-2ff0cdda4867 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1276 microversion: 2.1 time: 0.200974 Dec 21 04:06:08.605085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 174/385] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:08 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:08.618582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2cdc5e54-70a9-424a-846c-9388fdc972c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:08.634427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2cdc5e54-70a9-424a-846c-9388fdc972c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:08.641557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2cdc5e54-70a9-424a-846c-9388fdc972c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:08.643074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2cdc5e54-70a9-424a-846c-9388fdc972c6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.338521 Dec 21 04:06:08.653158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 212/386] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:08 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:06:08.849696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ff7473cc-24b8-43aa-955a-776dde3952d5 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:08.850365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ff7473cc-24b8-43aa-955a-776dde3952d5 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:08.858550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ff7473cc-24b8-43aa-955a-776dde3952d5 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:08.859134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ff7473cc-24b8-43aa-955a-776dde3952d5 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:08.859997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ff7473cc-24b8-43aa-955a-776dde3952d5 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:08.860491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ff7473cc-24b8-43aa-955a-776dde3952d5 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:09.190706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0e44bb92-2ea5-4c4e-b3c5-8d611efc71a8 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:09.191291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0e44bb92-2ea5-4c4e-b3c5-8d611efc71a8 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:09.200634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0e44bb92-2ea5-4c4e-b3c5-8d611efc71a8 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:09.201148 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0e44bb92-2ea5-4c4e-b3c5-8d611efc71a8 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:09.201994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0e44bb92-2ea5-4c4e-b3c5-8d611efc71a8 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:09.202490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0e44bb92-2ea5-4c4e-b3c5-8d611efc71a8 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:09.234986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ff7473cc-24b8-43aa-955a-776dde3952d5 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:09.248454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ff7473cc-24b8-43aa-955a-776dde3952d5 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1510 microversion: 2.1 time: 0.408602 Dec 21 04:06:09.249507 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 175/387] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:08 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1510 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:09.280147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0e44bb92-2ea5-4c4e-b3c5-8d611efc71a8 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Going to try to terminate instance {{(pid=94299) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:06:09.410759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3a828259-e8bb-4bd2-9256-8934c1c3d6ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:09.413075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3a828259-e8bb-4bd2-9256-8934c1c3d6ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:09.423897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a828259-e8bb-4bd2-9256-8934c1c3d6ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:09.424941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a828259-e8bb-4bd2-9256-8934c1c3d6ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:09.426266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a828259-e8bb-4bd2-9256-8934c1c3d6ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:09.427191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a828259-e8bb-4bd2-9256-8934c1c3d6ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:09.466077 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0e44bb92-2ea5-4c4e-b3c5-8d611efc71a8 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "DELETE /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 204 len: 0 microversion: 2.1 time: 0.284042 Dec 21 04:06:09.466962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 213/388] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:06:09 2020] DELETE /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 21 04:06:09.500006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0b8bae4d-c1e2-4e88-8dc0-e52da9ab5e4b tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:09.501055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0b8bae4d-c1e2-4e88-8dc0-e52da9ab5e4b tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:09.515115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0b8bae4d-c1e2-4e88-8dc0-e52da9ab5e4b tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:09.515762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0b8bae4d-c1e2-4e88-8dc0-e52da9ab5e4b tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:09.521681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0b8bae4d-c1e2-4e88-8dc0-e52da9ab5e4b tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:09.522318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0b8bae4d-c1e2-4e88-8dc0-e52da9ab5e4b tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:09.699345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3a828259-e8bb-4bd2-9256-8934c1c3d6ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 36877 microversion: 2.1 time: 0.305074 Dec 21 04:06:09.700396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 176/389] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:09 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 36877 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:06:09.715784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a4b0f54e-9579-4702-a5d0-88694ff43a97 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:09.716798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a4b0f54e-9579-4702-a5d0-88694ff43a97 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:09.727714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4b0f54e-9579-4702-a5d0-88694ff43a97 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:09.729011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4b0f54e-9579-4702-a5d0-88694ff43a97 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:09.730067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4b0f54e-9579-4702-a5d0-88694ff43a97 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:09.730701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4b0f54e-9579-4702-a5d0-88694ff43a97 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:09.931549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0b8bae4d-c1e2-4e88-8dc0-e52da9ab5e4b tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:09.940561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0b8bae4d-c1e2-4e88-8dc0-e52da9ab5e4b tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1502 microversion: 2.1 time: 0.468935 Dec 21 04:06:09.941184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 214/390] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:09 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1502 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:09.962138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-af541d07-2fae-4c71-ba1a-6f4a5098fe6d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:09.962813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-af541d07-2fae-4c71-ba1a-6f4a5098fe6d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:09.970979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af541d07-2fae-4c71-ba1a-6f4a5098fe6d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:09.971500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af541d07-2fae-4c71-ba1a-6f4a5098fe6d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:09.972403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af541d07-2fae-4c71-ba1a-6f4a5098fe6d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:09.972899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af541d07-2fae-4c71-ba1a-6f4a5098fe6d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:10.215634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-af541d07-2fae-4c71-ba1a-6f4a5098fe6d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:10.231576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-af541d07-2fae-4c71-ba1a-6f4a5098fe6d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:10.239129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-af541d07-2fae-4c71-ba1a-6f4a5098fe6d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:10.241263 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-af541d07-2fae-4c71-ba1a-6f4a5098fe6d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.288224 Dec 21 04:06:10.241941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 215/391] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:09 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:10.275267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-abd55bd3-2808-4bfd-bc20-e83d6779c37f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:10.276078 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-abd55bd3-2808-4bfd-bc20-e83d6779c37f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:10.284354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abd55bd3-2808-4bfd-bc20-e83d6779c37f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:10.284865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abd55bd3-2808-4bfd-bc20-e83d6779c37f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:10.285714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abd55bd3-2808-4bfd-bc20-e83d6779c37f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:10.286316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abd55bd3-2808-4bfd-bc20-e83d6779c37f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:10.538633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-abd55bd3-2808-4bfd-bc20-e83d6779c37f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:10.547797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-abd55bd3-2808-4bfd-bc20-e83d6779c37f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1516 microversion: 2.1 time: 0.282618 Dec 21 04:06:10.548381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 216/392] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:10 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1516 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:10.553839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a4b0f54e-9579-4702-a5d0-88694ff43a97 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:10.570202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a4b0f54e-9579-4702-a5d0-88694ff43a97 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1318 microversion: 2.1 time: 0.867073 Dec 21 04:06:10.579023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 177/393] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:09 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1318 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:10.718316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a8dc5946-a8fe-4cea-aa5c-18def7a5c543 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:10.719439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a8dc5946-a8fe-4cea-aa5c-18def7a5c543 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:10.728258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8dc5946-a8fe-4cea-aa5c-18def7a5c543 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:10.729023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8dc5946-a8fe-4cea-aa5c-18def7a5c543 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:10.729607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8dc5946-a8fe-4cea-aa5c-18def7a5c543 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:10.730107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8dc5946-a8fe-4cea-aa5c-18def7a5c543 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:10.935715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-1c55c11a-c80e-496f-8b55-3327c59d1cf3 req-7fd81d3a-b73d-4487-9b44-4e3fe174cf78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c", "tag": "90b6e1de-3fc7-4c40-b111-b929afe53945"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:10.949439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.949439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:10.966883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-1c55c11a-c80e-496f-8b55-3327c59d1cf3 req-7fd81d3a-b73d-4487-9b44-4e3fe174cf78 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:10.968855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-1c55c11a-c80e-496f-8b55-3327c59d1cf3 req-7fd81d3a-b73d-4487-9b44-4e3fe174cf78 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:10.996975 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-1c55c11a-c80e-496f-8b55-3327c59d1cf3 req-7fd81d3a-b73d-4487-9b44-4e3fe174cf78 service nova] Creating event network-changed:90b6e1de-3fc7-4c40-b111-b929afe53945 for instance cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c on hv-cinder-73306 Dec 21 04:06:11.002832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-1c55c11a-c80e-496f-8b55-3327c59d1cf3 req-7fd81d3a-b73d-4487-9b44-4e3fe174cf78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076792 Dec 21 04:06:11.003578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 178/394] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:10 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:11.016464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-23bac3dd-9ae5-4d0b-b9ae-28cfb6c1f25d tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:11.017436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-23bac3dd-9ae5-4d0b-b9ae-28cfb6c1f25d tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:11.027450 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23bac3dd-9ae5-4d0b-b9ae-28cfb6c1f25d tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:11.028309 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23bac3dd-9ae5-4d0b-b9ae-28cfb6c1f25d tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:11.029517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23bac3dd-9ae5-4d0b-b9ae-28cfb6c1f25d tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:11.030262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23bac3dd-9ae5-4d0b-b9ae-28cfb6c1f25d tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:11.260024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-23bac3dd-9ae5-4d0b-b9ae-28cfb6c1f25d tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:11.268956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-23bac3dd-9ae5-4d0b-b9ae-28cfb6c1f25d tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1502 microversion: 2.1 time: 0.264125 Dec 21 04:06:11.269551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 179/395] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:11 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:11.281029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cd51d8ce-2214-463f-b379-c2d135c5cb7b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:11.281690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cd51d8ce-2214-463f-b379-c2d135c5cb7b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:11.290087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cd51d8ce-2214-463f-b379-c2d135c5cb7b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:11.290599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cd51d8ce-2214-463f-b379-c2d135c5cb7b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:11.291482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cd51d8ce-2214-463f-b379-c2d135c5cb7b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:11.291979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cd51d8ce-2214-463f-b379-c2d135c5cb7b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:11.513723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cd51d8ce-2214-463f-b379-c2d135c5cb7b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:11.528839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cd51d8ce-2214-463f-b379-c2d135c5cb7b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:11.535301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cd51d8ce-2214-463f-b379-c2d135c5cb7b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:11.536657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cd51d8ce-2214-463f-b379-c2d135c5cb7b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.264211 Dec 21 04:06:11.537232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 180/396] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:11 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:11.595561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-23cf326c-5fc7-45bf-9abe-6a5714fc93d8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:11.596231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-23cf326c-5fc7-45bf-9abe-6a5714fc93d8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:11.604180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23cf326c-5fc7-45bf-9abe-6a5714fc93d8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:11.604689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23cf326c-5fc7-45bf-9abe-6a5714fc93d8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:11.605518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23cf326c-5fc7-45bf-9abe-6a5714fc93d8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:11.606011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23cf326c-5fc7-45bf-9abe-6a5714fc93d8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:11.828693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-23cf326c-5fc7-45bf-9abe-6a5714fc93d8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:11.837534 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-23cf326c-5fc7-45bf-9abe-6a5714fc93d8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1318 microversion: 2.1 time: 0.251235 Dec 21 04:06:11.838129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 181/397] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:11 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:11.847734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1347665809", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2008430900", "security_groups": [{"name": "tempest-TestShelveInstance-1443436908"}], "networks": [{"uuid": "013b4941-7458-42a2-bded-2718d1174ace"}], "block_device_mapping_v2": [{"uuid": "68380912-4b83-43c0-9cb1-58a16d6019e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:12.049873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] validate_networks() for [('013b4941-7458-42a2-bded-2718d1174ace', None, None, None)] {{(pid=94298) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:06:12.629642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Flavor limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:06:12.630162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Image limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:06:12.630675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Flavor pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:06:12.631185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Image pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:06:12.631651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:06:12.640553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:12.641056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:12.641921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:12.642413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:12.661701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Getting quotas for project b07ec805977d456b9447a634af514cde. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:06:12.665988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Getting quotas for user b9ff84deff8a4f01911a9cec1145b5d9 and project b07ec805977d456b9447a634af514cde. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:06:12.773630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Going to run 1 instances... {{(pid=94298) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:06:12.776094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68380912-4b83-43c0-9cb1-58a16d6019e5',volume_size=None,volume_type=None)] {{(pid=94298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:06:12.952407 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-acfe4c07-6f34-4452-93a4-f15a3a5e418f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 1.113168 Dec 21 04:06:12.953102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 182/398] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:06:11 2020] POST /compute/v2.1/servers => generated 410 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:06:12.964774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d32a5525-2a89-4711-985f-440244437c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:12.965434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d32a5525-2a89-4711-985f-440244437c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:12.974512 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d32a5525-2a89-4711-985f-440244437c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:12.975075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d32a5525-2a89-4711-985f-440244437c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:12.975873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d32a5525-2a89-4711-985f-440244437c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:12.976366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d32a5525-2a89-4711-985f-440244437c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:13.209007 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d32a5525-2a89-4711-985f-440244437c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:13.219732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d32a5525-2a89-4711-985f-440244437c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1502 microversion: 2.1 time: 0.264654 Dec 21 04:06:13.220318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 183/399] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:12 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:13.241421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dc01658e-5c36-493a-9a94-08520d4c8cf6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:13.242489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dc01658e-5c36-493a-9a94-08520d4c8cf6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:13.250766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc01658e-5c36-493a-9a94-08520d4c8cf6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:13.251305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc01658e-5c36-493a-9a94-08520d4c8cf6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:13.252678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc01658e-5c36-493a-9a94-08520d4c8cf6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:13.253168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc01658e-5c36-493a-9a94-08520d4c8cf6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:13.474252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dc01658e-5c36-493a-9a94-08520d4c8cf6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:13.489678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dc01658e-5c36-493a-9a94-08520d4c8cf6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:13.496361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dc01658e-5c36-493a-9a94-08520d4c8cf6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:13.497562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dc01658e-5c36-493a-9a94-08520d4c8cf6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.273747 Dec 21 04:06:13.498151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 184/400] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:13 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:13.508756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5d56daf7-92ca-469a-b487-509c30443b31 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:13.509424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5d56daf7-92ca-469a-b487-509c30443b31 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:13.517114 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d56daf7-92ca-469a-b487-509c30443b31 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:13.517625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d56daf7-92ca-469a-b487-509c30443b31 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:13.518460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d56daf7-92ca-469a-b487-509c30443b31 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:13.518984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d56daf7-92ca-469a-b487-509c30443b31 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:13.737137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5d56daf7-92ca-469a-b487-509c30443b31 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:13.746888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5d56daf7-92ca-469a-b487-509c30443b31 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1318 microversion: 2.1 time: 0.247714 Dec 21 04:06:13.747510 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 185/401] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:13 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:13.757098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-180753e5-8e00-455c-9fec-661be25466b6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:13.757749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-180753e5-8e00-455c-9fec-661be25466b6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:13.765147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-180753e5-8e00-455c-9fec-661be25466b6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:13.765650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-180753e5-8e00-455c-9fec-661be25466b6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:13.766469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-180753e5-8e00-455c-9fec-661be25466b6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:13.766998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-180753e5-8e00-455c-9fec-661be25466b6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:13.898252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-180753e5-8e00-455c-9fec-661be25466b6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:13.907086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-180753e5-8e00-455c-9fec-661be25466b6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1139 microversion: 2.1 time: 0.158521 Dec 21 04:06:13.907683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 186/402] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:13 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1139 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:14.051304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a8dc5946-a8fe-4cea-aa5c-18def7a5c543 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 200 len: 38215 microversion: 2.1 time: 3.342029 Dec 21 04:06:14.052738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 217/403] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:10 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 38215 bytes in 3345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:06:14.068455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8f5926e7-c972-43ca-bf31-e58281b8f82a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:14.068998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8f5926e7-c972-43ca-bf31-e58281b8f82a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:14.076882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f5926e7-c972-43ca-bf31-e58281b8f82a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:14.077395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f5926e7-c972-43ca-bf31-e58281b8f82a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:14.078239 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f5926e7-c972-43ca-bf31-e58281b8f82a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:14.078737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f5926e7-c972-43ca-bf31-e58281b8f82a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:14.147007 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8f5926e7-c972-43ca-bf31-e58281b8f82a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/ips" status: 200 len: 147 microversion: 2.1 time: 0.087631 Dec 21 04:06:14.147857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 187/404] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Dec 21 04:06:14 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/ips => generated 147 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:14.244779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-34194124-f864-4845-b104-d474de71650f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:14.247138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-34194124-f864-4845-b104-d474de71650f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:14.257709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34194124-f864-4845-b104-d474de71650f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:14.258333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34194124-f864-4845-b104-d474de71650f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:14.259268 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34194124-f864-4845-b104-d474de71650f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:14.259760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34194124-f864-4845-b104-d474de71650f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:14.524103 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-69326f3e-5623-4f60-aa43-ec3f7311f4ed tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:14.524778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-69326f3e-5623-4f60-aa43-ec3f7311f4ed tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:14.544620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69326f3e-5623-4f60-aa43-ec3f7311f4ed tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:14.545358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69326f3e-5623-4f60-aa43-ec3f7311f4ed tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:14.546361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69326f3e-5623-4f60-aa43-ec3f7311f4ed tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:14.547550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69326f3e-5623-4f60-aa43-ec3f7311f4ed tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:14.594031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-34194124-f864-4845-b104-d474de71650f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:14.615843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-34194124-f864-4845-b104-d474de71650f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1502 microversion: 2.1 time: 0.381723 Dec 21 04:06:14.617180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 218/405] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:14 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1502 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:14.770741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c995e7dc-85e6-4b1e-a0bf-e02970cb7a8d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:14.771478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c995e7dc-85e6-4b1e-a0bf-e02970cb7a8d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:14.779600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c995e7dc-85e6-4b1e-a0bf-e02970cb7a8d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:14.780113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c995e7dc-85e6-4b1e-a0bf-e02970cb7a8d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:14.780952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c995e7dc-85e6-4b1e-a0bf-e02970cb7a8d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:14.781444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c995e7dc-85e6-4b1e-a0bf-e02970cb7a8d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:14.905160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-69326f3e-5623-4f60-aa43-ec3f7311f4ed tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:14.920549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-69326f3e-5623-4f60-aa43-ec3f7311f4ed tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:14.927390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-69326f3e-5623-4f60-aa43-ec3f7311f4ed tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:14.928638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-69326f3e-5623-4f60-aa43-ec3f7311f4ed tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.414976 Dec 21 04:06:14.929426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 188/406] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:14 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:14.943794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f270db7d-046c-4a31-931c-f47cdd976ce4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:14.944450 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f270db7d-046c-4a31-931c-f47cdd976ce4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:14.952414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f270db7d-046c-4a31-931c-f47cdd976ce4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:14.952899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f270db7d-046c-4a31-931c-f47cdd976ce4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:14.953881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f270db7d-046c-4a31-931c-f47cdd976ce4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:14.954189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f270db7d-046c-4a31-931c-f47cdd976ce4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:15.019899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c995e7dc-85e6-4b1e-a0bf-e02970cb7a8d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:15.031295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c995e7dc-85e6-4b1e-a0bf-e02970cb7a8d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1318 microversion: 2.1 time: 0.270319 Dec 21 04:06:15.032684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 219/407] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:14 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:15.113449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f270db7d-046c-4a31-931c-f47cdd976ce4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:15.122772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f270db7d-046c-4a31-931c-f47cdd976ce4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1187 microversion: 2.1 time: 0.187792 Dec 21 04:06:15.123572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 189/408] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:14 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1187 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:15.562129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-11303a20-e91f-4127-b782-a4394a87ed28 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:15.563099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-11303a20-e91f-4127-b782-a4394a87ed28 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:15.572428 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11303a20-e91f-4127-b782-a4394a87ed28 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:15.573262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11303a20-e91f-4127-b782-a4394a87ed28 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:15.574311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11303a20-e91f-4127-b782-a4394a87ed28 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:15.575059 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11303a20-e91f-4127-b782-a4394a87ed28 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:15.641870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-40fbb9b8-b748-48d2-8a26-5c0bc3dbc336 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:15.646962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-40fbb9b8-b748-48d2-8a26-5c0bc3dbc336 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:15.662873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-40fbb9b8-b748-48d2-8a26-5c0bc3dbc336 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:15.664865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-40fbb9b8-b748-48d2-8a26-5c0bc3dbc336 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:15.665737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-40fbb9b8-b748-48d2-8a26-5c0bc3dbc336 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:15.666239 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-40fbb9b8-b748-48d2-8a26-5c0bc3dbc336 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:15.821163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-11303a20-e91f-4127-b782-a4394a87ed28 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:15.836044 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-11303a20-e91f-4127-b782-a4394a87ed28 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1516 microversion: 2.1 time: 0.282806 Dec 21 04:06:15.836792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 220/409] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:15 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:15.859399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-75ffa8b2-c33b-4d69-9e27-cf97e43fc86d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f1f2b1e-c4b0-41a7-93b7-3aca1dd950ea"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:15.860730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-75ffa8b2-c33b-4d69-9e27-cf97e43fc86d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:15.869775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75ffa8b2-c33b-4d69-9e27-cf97e43fc86d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:15.870389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75ffa8b2-c33b-4d69-9e27-cf97e43fc86d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:15.871382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75ffa8b2-c33b-4d69-9e27-cf97e43fc86d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:15.871966 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75ffa8b2-c33b-4d69-9e27-cf97e43fc86d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:16.490250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-40fbb9b8-b748-48d2-8a26-5c0bc3dbc336 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:16.503781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-40fbb9b8-b748-48d2-8a26-5c0bc3dbc336 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1502 microversion: 2.1 time: 0.873730 Dec 21 04:06:16.505776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 190/410] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:15 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1502 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:16.516501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4c22ca26-e6e4-4f3f-9796-8315d2275595 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:16.517167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4c22ca26-e6e4-4f3f-9796-8315d2275595 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:16.526365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c22ca26-e6e4-4f3f-9796-8315d2275595 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:16.526885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c22ca26-e6e4-4f3f-9796-8315d2275595 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:16.527771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c22ca26-e6e4-4f3f-9796-8315d2275595 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:16.529048 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c22ca26-e6e4-4f3f-9796-8315d2275595 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:17.108010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-75ffa8b2-c33b-4d69-9e27-cf97e43fc86d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "POST /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.257531 Dec 21 04:06:17.109380 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 221/411] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Dec 21 04:06:15 2020] POST /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/os-volume_attachments => generated 194 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:06:17.110612 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4c22ca26-e6e4-4f3f-9796-8315d2275595 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:17.160475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0a126a3d-559e-452a-928e-57b0cf919875 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:17.164409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0a126a3d-559e-452a-928e-57b0cf919875 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:17.174447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4c22ca26-e6e4-4f3f-9796-8315d2275595 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:17.183069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4c22ca26-e6e4-4f3f-9796-8315d2275595 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:17.195025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4c22ca26-e6e4-4f3f-9796-8315d2275595 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.677901 Dec 21 04:06:17.195025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 191/412] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:16 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:17.199402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a126a3d-559e-452a-928e-57b0cf919875 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:17.203340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a126a3d-559e-452a-928e-57b0cf919875 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:17.205246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a126a3d-559e-452a-928e-57b0cf919875 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:17.208031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a126a3d-559e-452a-928e-57b0cf919875 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:17.209788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f2eb4ca0-368c-4f9f-905c-23a888f5522c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:17.210454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f2eb4ca0-368c-4f9f-905c-23a888f5522c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:17.219604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2eb4ca0-368c-4f9f-905c-23a888f5522c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:17.220118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2eb4ca0-368c-4f9f-905c-23a888f5522c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:17.222438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2eb4ca0-368c-4f9f-905c-23a888f5522c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:17.222992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2eb4ca0-368c-4f9f-905c-23a888f5522c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:17.440497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f2eb4ca0-368c-4f9f-905c-23a888f5522c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:17.453878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f2eb4ca0-368c-4f9f-905c-23a888f5522c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1205 microversion: 2.1 time: 0.254780 Dec 21 04:06:17.455286 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 192/413] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:17 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1205 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:17.470304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-dbcef92b-6284-4c64-a29d-b7b8b8a7275c req-1750bd3e-cbdd-468a-b9c2-ff6ead816059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da035a33-faa9-433e-805f-0d351e6d42ed", "name": "network-vif-unplugged", "status": "completed", "tag": "1f491f5c-823e-4db1-81ec-37a517ac94f3"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:17.480665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:17.480665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:17.494835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-dbcef92b-6284-4c64-a29d-b7b8b8a7275c req-1750bd3e-cbdd-468a-b9c2-ff6ead816059 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:17.495550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-dbcef92b-6284-4c64-a29d-b7b8b8a7275c req-1750bd3e-cbdd-468a-b9c2-ff6ead816059 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:17.524539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-dbcef92b-6284-4c64-a29d-b7b8b8a7275c req-1750bd3e-cbdd-468a-b9c2-ff6ead816059 service nova] Creating event network-vif-unplugged:1f491f5c-823e-4db1-81ec-37a517ac94f3 for instance da035a33-faa9-433e-805f-0d351e6d42ed on hv-cinder-73306 Dec 21 04:06:17.530894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-dbcef92b-6284-4c64-a29d-b7b8b8a7275c req-1750bd3e-cbdd-468a-b9c2-ff6ead816059 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074045 Dec 21 04:06:17.531761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 193/414] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:17 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:17.550356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-98425ae7-973e-4c28-937b-2df29a130ce7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:17.551551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-98425ae7-973e-4c28-937b-2df29a130ce7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:17.555955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0a126a3d-559e-452a-928e-57b0cf919875 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:17.562425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-98425ae7-973e-4c28-937b-2df29a130ce7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:17.563017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-98425ae7-973e-4c28-937b-2df29a130ce7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:17.564944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0a126a3d-559e-452a-928e-57b0cf919875 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1318 microversion: 2.1 time: 0.452875 Dec 21 04:06:17.565286 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-98425ae7-973e-4c28-937b-2df29a130ce7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:17.565459 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 222/415] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:17 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:17.565790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-98425ae7-973e-4c28-937b-2df29a130ce7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:17.953226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-98425ae7-973e-4c28-937b-2df29a130ce7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:17.963516 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-98425ae7-973e-4c28-937b-2df29a130ce7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1502 microversion: 2.1 time: 0.425769 Dec 21 04:06:17.964393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 194/416] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:17 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1502 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:18.211126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-94e251d7-9b08-482b-925b-d314d550e07a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:18.211870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-94e251d7-9b08-482b-925b-d314d550e07a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:18.220024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-94e251d7-9b08-482b-925b-d314d550e07a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:18.220606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-94e251d7-9b08-482b-925b-d314d550e07a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:18.221651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-94e251d7-9b08-482b-925b-d314d550e07a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:18.222367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-94e251d7-9b08-482b-925b-d314d550e07a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:18.465426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-94e251d7-9b08-482b-925b-d314d550e07a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:18.483960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b3c9feef-de8d-492b-a276-bca3032c6b5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:18.484839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b3c9feef-de8d-492b-a276-bca3032c6b5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:18.494394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3c9feef-de8d-492b-a276-bca3032c6b5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:18.495713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3c9feef-de8d-492b-a276-bca3032c6b5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:18.497332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3c9feef-de8d-492b-a276-bca3032c6b5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:18.498009 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3c9feef-de8d-492b-a276-bca3032c6b5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:18.499368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-94e251d7-9b08-482b-925b-d314d550e07a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:18.521052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-94e251d7-9b08-482b-925b-d314d550e07a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:18.522313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-94e251d7-9b08-482b-925b-d314d550e07a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.321609 Dec 21 04:06:18.523234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 223/417] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:18 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:18.588796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3f842e02-c250-44c6-b1b8-da5c85015d20 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:18.589695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3f842e02-c250-44c6-b1b8-da5c85015d20 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:18.598147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3f842e02-c250-44c6-b1b8-da5c85015d20 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:18.599698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3f842e02-c250-44c6-b1b8-da5c85015d20 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:18.600795 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3f842e02-c250-44c6-b1b8-da5c85015d20 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:18.601213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3f842e02-c250-44c6-b1b8-da5c85015d20 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:18.841192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3f842e02-c250-44c6-b1b8-da5c85015d20 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:18.851533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3f842e02-c250-44c6-b1b8-da5c85015d20 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1318 microversion: 2.1 time: 0.272255 Dec 21 04:06:18.860301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 224/418] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:18 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:18.862956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-15bbe189-6ccc-4160-b4f0-ecc4bbe34885 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72c41131-0fb2-4aa0-8a3c-92a6f3ff9512"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:18.865211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-15bbe189-6ccc-4160-b4f0-ecc4bbe34885 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:18.874180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15bbe189-6ccc-4160-b4f0-ecc4bbe34885 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:18.874681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15bbe189-6ccc-4160-b4f0-ecc4bbe34885 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:18.878409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15bbe189-6ccc-4160-b4f0-ecc4bbe34885 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:18.878409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15bbe189-6ccc-4160-b4f0-ecc4bbe34885 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:19.293245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-15bbe189-6ccc-4160-b4f0-ecc4bbe34885 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439511 Dec 21 04:06:19.294101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 225/419] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Dec 21 04:06:18 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:19.307983 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-782d343d-1af6-40f2-be14-bbb1f9286b78 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:19.308947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-782d343d-1af6-40f2-be14-bbb1f9286b78 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:19.321476 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-782d343d-1af6-40f2-be14-bbb1f9286b78 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:19.322252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-782d343d-1af6-40f2-be14-bbb1f9286b78 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:19.323835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-782d343d-1af6-40f2-be14-bbb1f9286b78 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:19.324516 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-782d343d-1af6-40f2-be14-bbb1f9286b78 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:19.509326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b3c9feef-de8d-492b-a276-bca3032c6b5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:19.531641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b3c9feef-de8d-492b-a276-bca3032c6b5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 1.062758 Dec 21 04:06:19.532490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 195/420] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:18 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:19.555182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2981c410-488c-43b2-9170-438e8b41b98c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:19.555852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2981c410-488c-43b2-9170-438e8b41b98c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:19.563799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2981c410-488c-43b2-9170-438e8b41b98c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:19.564305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2981c410-488c-43b2-9170-438e8b41b98c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:19.565142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2981c410-488c-43b2-9170-438e8b41b98c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:19.565626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2981c410-488c-43b2-9170-438e8b41b98c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:19.621677 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-782d343d-1af6-40f2-be14-bbb1f9286b78 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:19.631741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-782d343d-1af6-40f2-be14-bbb1f9286b78 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1502 microversion: 2.1 time: 0.336409 Dec 21 04:06:19.643100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 226/421] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:19 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1502 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:19.876630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6c625ae2-8eae-4e26-ac74-b24f1e3374b4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:19.877610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6c625ae2-8eae-4e26-ac74-b24f1e3374b4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:19.885875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c625ae2-8eae-4e26-ac74-b24f1e3374b4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:19.886380 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c625ae2-8eae-4e26-ac74-b24f1e3374b4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:19.887373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c625ae2-8eae-4e26-ac74-b24f1e3374b4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:19.887866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c625ae2-8eae-4e26-ac74-b24f1e3374b4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:20.144877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6c625ae2-8eae-4e26-ac74-b24f1e3374b4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:20.154111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6c625ae2-8eae-4e26-ac74-b24f1e3374b4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1318 microversion: 2.1 time: 0.287069 Dec 21 04:06:20.154720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 227/422] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:19 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:20.171461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-6928a81c-db0d-4799-859f-b5cd6cf3cfcd req-cf8f9c84-8632-4198-a76a-e9b4ae165f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c", "name": "network-vif-plugged", "status": "completed", "tag": "90b6e1de-3fc7-4c40-b111-b929afe53945"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:20.178723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:20.178723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:20.187751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-6928a81c-db0d-4799-859f-b5cd6cf3cfcd req-cf8f9c84-8632-4198-a76a-e9b4ae165f2a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:20.188246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-6928a81c-db0d-4799-859f-b5cd6cf3cfcd req-cf8f9c84-8632-4198-a76a-e9b4ae165f2a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:20.206529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-6928a81c-db0d-4799-859f-b5cd6cf3cfcd req-cf8f9c84-8632-4198-a76a-e9b4ae165f2a service nova] Creating event network-vif-plugged:90b6e1de-3fc7-4c40-b111-b929afe53945 for instance cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c on hv-cinder-73306 Dec 21 04:06:20.211514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-6928a81c-db0d-4799-859f-b5cd6cf3cfcd req-cf8f9c84-8632-4198-a76a-e9b4ae165f2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055485 Dec 21 04:06:20.212342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 228/423] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:20 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:20.223233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2981c410-488c-43b2-9170-438e8b41b98c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:20.237790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-a46fcca2-bdbf-420e-b86a-74c54d9eeb90 req-44b1ecad-8ca1-4200-9be2-e65ca8877ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da035a33-faa9-433e-805f-0d351e6d42ed", "name": "network-vif-deleted", "tag": "1f491f5c-823e-4db1-81ec-37a517ac94f3"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:20.241568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2981c410-488c-43b2-9170-438e8b41b98c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:20.248477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2981c410-488c-43b2-9170-438e8b41b98c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:20.249025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:20.249025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:20.250216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2981c410-488c-43b2-9170-438e8b41b98c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.705085 Dec 21 04:06:20.251144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 196/424] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:19 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:20.260674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-a46fcca2-bdbf-420e-b86a-74c54d9eeb90 req-44b1ecad-8ca1-4200-9be2-e65ca8877ee7 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:20.261175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-a46fcca2-bdbf-420e-b86a-74c54d9eeb90 req-44b1ecad-8ca1-4200-9be2-e65ca8877ee7 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:20.284016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-a46fcca2-bdbf-420e-b86a-74c54d9eeb90 req-44b1ecad-8ca1-4200-9be2-e65ca8877ee7 service nova] Creating event network-vif-deleted:1f491f5c-823e-4db1-81ec-37a517ac94f3 for instance da035a33-faa9-433e-805f-0d351e6d42ed on hv-cinder-73306 Dec 21 04:06:20.289094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-a46fcca2-bdbf-420e-b86a-74c54d9eeb90 req-44b1ecad-8ca1-4200-9be2-e65ca8877ee7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073739 Dec 21 04:06:20.290275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 229/425] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:20 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:20.557308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9c4284f5-5831-4399-bec1-660f72746625 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:20.558084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9c4284f5-5831-4399-bec1-660f72746625 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:20.566137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c4284f5-5831-4399-bec1-660f72746625 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:20.566892 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c4284f5-5831-4399-bec1-660f72746625 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:20.567929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c4284f5-5831-4399-bec1-660f72746625 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:20.568425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c4284f5-5831-4399-bec1-660f72746625 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:20.668754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3c349b7f-46c8-46c9-be5a-711d52263a24 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:20.669666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3c349b7f-46c8-46c9-be5a-711d52263a24 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:20.679433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c349b7f-46c8-46c9-be5a-711d52263a24 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:20.680124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c349b7f-46c8-46c9-be5a-711d52263a24 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:20.681139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c349b7f-46c8-46c9-be5a-711d52263a24 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:20.681927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c349b7f-46c8-46c9-be5a-711d52263a24 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:20.773736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c349b7f-46c8-46c9-be5a-711d52263a24 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:20.774251 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c349b7f-46c8-46c9-be5a-711d52263a24 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:20.774939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-3c349b7f-46c8-46c9-be5a-711d52263a24 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lazy-loading 'fault' on Instance uuid da035a33-faa9-433e-805f-0d351e6d42ed {{(pid=94299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:06:20.899391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3c349b7f-46c8-46c9-be5a-711d52263a24 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:20.913795 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3c349b7f-46c8-46c9-be5a-711d52263a24 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 200 len: 1303 microversion: 2.1 time: 0.260569 Dec 21 04:06:20.914726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 230/426] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:20 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 1303 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:21.031097 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9c4284f5-5831-4399-bec1-660f72746625 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:21.047576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9c4284f5-5831-4399-bec1-660f72746625 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.495993 Dec 21 04:06:21.058002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 197/427] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:20 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:21.179958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-957f3099-036a-471e-b4f6-b1f9a70d82ed tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:21.180623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-957f3099-036a-471e-b4f6-b1f9a70d82ed tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:21.189410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-957f3099-036a-471e-b4f6-b1f9a70d82ed tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:21.189911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-957f3099-036a-471e-b4f6-b1f9a70d82ed tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:21.190751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-957f3099-036a-471e-b4f6-b1f9a70d82ed tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:21.191269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-957f3099-036a-471e-b4f6-b1f9a70d82ed tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:21.280050 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7b79d87a-e93e-47b1-bb8f-1b20f17e7868 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:21.299819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7b79d87a-e93e-47b1-bb8f-1b20f17e7868 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:21.314036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b79d87a-e93e-47b1-bb8f-1b20f17e7868 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:21.314806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b79d87a-e93e-47b1-bb8f-1b20f17e7868 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:21.315843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b79d87a-e93e-47b1-bb8f-1b20f17e7868 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:21.316506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b79d87a-e93e-47b1-bb8f-1b20f17e7868 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:21.468585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-957f3099-036a-471e-b4f6-b1f9a70d82ed tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:21.478743 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-957f3099-036a-471e-b4f6-b1f9a70d82ed tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1318 microversion: 2.1 time: 0.308951 Dec 21 04:06:21.479378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 231/428] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:21 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:21.764406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7b79d87a-e93e-47b1-bb8f-1b20f17e7868 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:21.779071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7b79d87a-e93e-47b1-bb8f-1b20f17e7868 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:21.785874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7b79d87a-e93e-47b1-bb8f-1b20f17e7868 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:21.787249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7b79d87a-e93e-47b1-bb8f-1b20f17e7868 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.520622 Dec 21 04:06:21.787905 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 198/429] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:21 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:21.938140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5170dfe8-8252-4dc1-9071-500884007733 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:21.938937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5170dfe8-8252-4dc1-9071-500884007733 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: da035a33-faa9-433e-805f-0d351e6d42ed] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:21.947636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5170dfe8-8252-4dc1-9071-500884007733 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:21.948275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5170dfe8-8252-4dc1-9071-500884007733 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:21.949228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5170dfe8-8252-4dc1-9071-500884007733 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:21.949828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5170dfe8-8252-4dc1-9071-500884007733 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:22.005581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-5170dfe8-8252-4dc1-9071-500884007733 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] HTTP exception thrown: Instance da035a33-faa9-433e-805f-0d351e6d42ed could not be found. Dec 21 04:06:22.006168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5170dfe8-8252-4dc1-9071-500884007733 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Returning 404 to user: Instance da035a33-faa9-433e-805f-0d351e6d42ed could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:06:22.007108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5170dfe8-8252-4dc1-9071-500884007733 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed" status: 404 len: 111 microversion: 2.1 time: 0.078332 Dec 21 04:06:22.007723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 232/430] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:21 2020] GET /compute/v2.1/servers/da035a33-faa9-433e-805f-0d351e6d42ed => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:06:22.073991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fe7b5a0b-8b13-4a7b-959a-f410b776f4e5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:22.074662 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fe7b5a0b-8b13-4a7b-959a-f410b776f4e5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:22.082727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe7b5a0b-8b13-4a7b-959a-f410b776f4e5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:22.083272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe7b5a0b-8b13-4a7b-959a-f410b776f4e5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:22.084089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe7b5a0b-8b13-4a7b-959a-f410b776f4e5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:22.084573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe7b5a0b-8b13-4a7b-959a-f410b776f4e5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:22.131329 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1447659442", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "networks": [{"uuid": "b2a3a343-ad64-49b0-b882-98a263ddf1dc"}]}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:22.314805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fe7b5a0b-8b13-4a7b-959a-f410b776f4e5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:22.323867 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fe7b5a0b-8b13-4a7b-959a-f410b776f4e5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.259614 Dec 21 04:06:22.324491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 199/431] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:22 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:22.335200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-939da5a3-1219-4544-83c7-91fb7561b695 req-0c836268-e699-435c-ad53-bffc7dd16606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c04726-583d-4c58-82b1-5baccee7c4a7", "tag": "499c69ca-3c31-461f-a533-f5bccf8a38fe"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:22.341911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:22.341911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:22.351581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-939da5a3-1219-4544-83c7-91fb7561b695 req-0c836268-e699-435c-ad53-bffc7dd16606 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:22.352081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-939da5a3-1219-4544-83c7-91fb7561b695 req-0c836268-e699-435c-ad53-bffc7dd16606 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:22.369335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-939da5a3-1219-4544-83c7-91fb7561b695 req-0c836268-e699-435c-ad53-bffc7dd16606 service nova] Creating event network-changed:499c69ca-3c31-461f-a533-f5bccf8a38fe for instance 56c04726-583d-4c58-82b1-5baccee7c4a7 on hv-cinder-73306 Dec 21 04:06:22.374261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-939da5a3-1219-4544-83c7-91fb7561b695 req-0c836268-e699-435c-ad53-bffc7dd16606 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048554 Dec 21 04:06:22.374889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 200/432] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:22 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:22.502935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-56c453dd-a237-4e2e-877d-73866e74b23d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:22.503702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-56c453dd-a237-4e2e-877d-73866e74b23d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:22.512160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56c453dd-a237-4e2e-877d-73866e74b23d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:22.512671 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56c453dd-a237-4e2e-877d-73866e74b23d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:22.513509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56c453dd-a237-4e2e-877d-73866e74b23d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:22.514001 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56c453dd-a237-4e2e-877d-73866e74b23d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:23.133864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-56c453dd-a237-4e2e-877d-73866e74b23d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:23.142656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-56c453dd-a237-4e2e-877d-73866e74b23d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1318 microversion: 2.1 time: 0.649382 Dec 21 04:06:23.143282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 201/433] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:22 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:23.153422 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-10614bf9-6d72-4993-8036-b5b690519927 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:23.154187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-10614bf9-6d72-4993-8036-b5b690519927 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:23.162740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10614bf9-6d72-4993-8036-b5b690519927 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:23.163312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10614bf9-6d72-4993-8036-b5b690519927 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:23.164152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10614bf9-6d72-4993-8036-b5b690519927 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:23.164659 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10614bf9-6d72-4993-8036-b5b690519927 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:23.616338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-10614bf9-6d72-4993-8036-b5b690519927 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:23.631559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-10614bf9-6d72-4993-8036-b5b690519927 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:23.638152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-10614bf9-6d72-4993-8036-b5b690519927 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:23.639478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-10614bf9-6d72-4993-8036-b5b690519927 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.495211 Dec 21 04:06:23.640147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 202/434] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:23 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:23.649686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-03e4f974-e4b6-42c7-9dd9-95543e8f33bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:23.650353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-03e4f974-e4b6-42c7-9dd9-95543e8f33bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:23.658374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03e4f974-e4b6-42c7-9dd9-95543e8f33bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:23.658877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03e4f974-e4b6-42c7-9dd9-95543e8f33bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:23.659729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03e4f974-e4b6-42c7-9dd9-95543e8f33bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:23.660214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03e4f974-e4b6-42c7-9dd9-95543e8f33bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:23.892869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-03e4f974-e4b6-42c7-9dd9-95543e8f33bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:23.902195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-03e4f974-e4b6-42c7-9dd9-95543e8f33bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.261005 Dec 21 04:06:23.902785 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 203/435] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:23 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:24.169533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-caa1b6e9-ade4-4da0-8a59-b694669b913e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:24.170195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-caa1b6e9-ade4-4da0-8a59-b694669b913e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:24.178245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-caa1b6e9-ade4-4da0-8a59-b694669b913e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:24.183029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-caa1b6e9-ade4-4da0-8a59-b694669b913e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:24.183029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-caa1b6e9-ade4-4da0-8a59-b694669b913e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:24.183029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-caa1b6e9-ade4-4da0-8a59-b694669b913e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:24.405895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-caa1b6e9-ade4-4da0-8a59-b694669b913e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:24.414990 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-caa1b6e9-ade4-4da0-8a59-b694669b913e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1509 microversion: 2.1 time: 0.257083 Dec 21 04:06:24.415587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 204/436] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:24 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:24.664926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b6c0e711-bd8e-40ad-9081-23a5a5da3316 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:24.665595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b6c0e711-bd8e-40ad-9081-23a5a5da3316 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:24.673672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b6c0e711-bd8e-40ad-9081-23a5a5da3316 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:24.674177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b6c0e711-bd8e-40ad-9081-23a5a5da3316 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:24.675035 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b6c0e711-bd8e-40ad-9081-23a5a5da3316 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:24.675529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b6c0e711-bd8e-40ad-9081-23a5a5da3316 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:24.932862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b6c0e711-bd8e-40ad-9081-23a5a5da3316 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:24.948504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b6c0e711-bd8e-40ad-9081-23a5a5da3316 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:24.955281 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b6c0e711-bd8e-40ad-9081-23a5a5da3316 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:24.956678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b6c0e711-bd8e-40ad-9081-23a5a5da3316 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.301459 Dec 21 04:06:24.957256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 205/437] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:24 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:24.968269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-379153ad-475c-4d05-a44f-8da35fa984db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:24.969096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-379153ad-475c-4d05-a44f-8da35fa984db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:24.987099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-379153ad-475c-4d05-a44f-8da35fa984db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:24.987636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-379153ad-475c-4d05-a44f-8da35fa984db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:24.988839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-379153ad-475c-4d05-a44f-8da35fa984db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:24.989445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-379153ad-475c-4d05-a44f-8da35fa984db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:25.216533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-379153ad-475c-4d05-a44f-8da35fa984db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:25.225757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-379153ad-475c-4d05-a44f-8da35fa984db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.266755 Dec 21 04:06:25.226363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 206/438] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:24 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:25.303080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b29d60cd-4e39-4280-9912-9d8f9f365714 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:25.304233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b29d60cd-4e39-4280-9912-9d8f9f365714 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:25.312066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b29d60cd-4e39-4280-9912-9d8f9f365714 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:25.312522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b29d60cd-4e39-4280-9912-9d8f9f365714 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:25.313343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b29d60cd-4e39-4280-9912-9d8f9f365714 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:25.313830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b29d60cd-4e39-4280-9912-9d8f9f365714 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:25.381527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-b29d60cd-4e39-4280-9912-9d8f9f365714 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lazy-loading 'flavor' on Instance uuid 066ef53e-6421-4004-bd12-2e238a638cd1 {{(pid=94298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:06:25.631215 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b29d60cd-4e39-4280-9912-9d8f9f365714 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "POST /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/action" status: 200 len: 32 microversion: 2.1 time: 0.337610 Dec 21 04:06:25.631885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 207/439] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:25 2020] POST /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/action => generated 32 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 21 04:06:25.647490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-efcc4a52-9e0c-4136-93d2-e4272f5d7755 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:25.648219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-efcc4a52-9e0c-4136-93d2-e4272f5d7755 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:25.656371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efcc4a52-9e0c-4136-93d2-e4272f5d7755 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:25.656882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efcc4a52-9e0c-4136-93d2-e4272f5d7755 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:25.657711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efcc4a52-9e0c-4136-93d2-e4272f5d7755 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:25.658202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efcc4a52-9e0c-4136-93d2-e4272f5d7755 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:26.031433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-efcc4a52-9e0c-4136-93d2-e4272f5d7755 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:26.042184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-efcc4a52-9e0c-4136-93d2-e4272f5d7755 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.404594 Dec 21 04:06:26.042774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 208/440] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:25 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:26.053476 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f43b4439-5109-4500-b2c6-ac655cbd6df3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:26.054464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f43b4439-5109-4500-b2c6-ac655cbd6df3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:26.062976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f43b4439-5109-4500-b2c6-ac655cbd6df3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:26.063569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f43b4439-5109-4500-b2c6-ac655cbd6df3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:26.064483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f43b4439-5109-4500-b2c6-ac655cbd6df3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:26.064980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f43b4439-5109-4500-b2c6-ac655cbd6df3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:26.430509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f43b4439-5109-4500-b2c6-ac655cbd6df3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:26.445516 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f43b4439-5109-4500-b2c6-ac655cbd6df3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:26.456639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f43b4439-5109-4500-b2c6-ac655cbd6df3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:26.462125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f43b4439-5109-4500-b2c6-ac655cbd6df3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.415093 Dec 21 04:06:26.462947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 209/441] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:26 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:26.474486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f57ea79a-48d4-4584-aafd-5db1e38b243f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40b0649d-a1a0-47a4-aac0-7ad90440a277"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:26.475824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f57ea79a-48d4-4584-aafd-5db1e38b243f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:26.484124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f57ea79a-48d4-4584-aafd-5db1e38b243f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:26.484637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f57ea79a-48d4-4584-aafd-5db1e38b243f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:26.485487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f57ea79a-48d4-4584-aafd-5db1e38b243f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:26.486246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f57ea79a-48d4-4584-aafd-5db1e38b243f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:26.897039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f57ea79a-48d4-4584-aafd-5db1e38b243f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "POST /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432756 Dec 21 04:06:26.897895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 210/442] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Dec 21 04:06:26 2020] POST /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:26.909608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b422f8cd-9e16-4610-8ab8-59973f92f55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:26.910289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b422f8cd-9e16-4610-8ab8-59973f92f55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:26.923152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b422f8cd-9e16-4610-8ab8-59973f92f55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:26.923916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b422f8cd-9e16-4610-8ab8-59973f92f55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:26.925258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b422f8cd-9e16-4610-8ab8-59973f92f55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:26.925936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b422f8cd-9e16-4610-8ab8-59973f92f55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:27.173981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b422f8cd-9e16-4610-8ab8-59973f92f55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:27.183543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b422f8cd-9e16-4610-8ab8-59973f92f55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.284625 Dec 21 04:06:27.184140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 211/443] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:26 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:27.194969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-aad9eb0a-0681-430c-a3cf-23a7e8c86c97 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:27.194969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-aad9eb0a-0681-430c-a3cf-23a7e8c86c97 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:27.203042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aad9eb0a-0681-430c-a3cf-23a7e8c86c97 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:27.203553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aad9eb0a-0681-430c-a3cf-23a7e8c86c97 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:27.204402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aad9eb0a-0681-430c-a3cf-23a7e8c86c97 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:27.204896 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aad9eb0a-0681-430c-a3cf-23a7e8c86c97 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:27.421987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-aad9eb0a-0681-430c-a3cf-23a7e8c86c97 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:27.431928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-aad9eb0a-0681-430c-a3cf-23a7e8c86c97 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.246765 Dec 21 04:06:27.432514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 212/444] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:27 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:27.486854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-73cf167f-b4e7-41ca-b16f-cf1d383263d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:27.487539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-73cf167f-b4e7-41ca-b16f-cf1d383263d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:27.496813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73cf167f-b4e7-41ca-b16f-cf1d383263d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:27.497089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73cf167f-b4e7-41ca-b16f-cf1d383263d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:27.497885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73cf167f-b4e7-41ca-b16f-cf1d383263d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:27.498374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73cf167f-b4e7-41ca-b16f-cf1d383263d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:27.718494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-73cf167f-b4e7-41ca-b16f-cf1d383263d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:27.733378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-73cf167f-b4e7-41ca-b16f-cf1d383263d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:27.740760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-73cf167f-b4e7-41ca-b16f-cf1d383263d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:27.741480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-73cf167f-b4e7-41ca-b16f-cf1d383263d0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.263784 Dec 21 04:06:27.742058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 213/445] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:27 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:06:28.209152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-84a80039-0823-4a26-9dd4-41c53018ccbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:28.209850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-84a80039-0823-4a26-9dd4-41c53018ccbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:28.219470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-84a80039-0823-4a26-9dd4-41c53018ccbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:28.219902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-84a80039-0823-4a26-9dd4-41c53018ccbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:28.220753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-84a80039-0823-4a26-9dd4-41c53018ccbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:28.221239 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-84a80039-0823-4a26-9dd4-41c53018ccbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:28.447354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-84a80039-0823-4a26-9dd4-41c53018ccbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:28.456257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-84a80039-0823-4a26-9dd4-41c53018ccbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.256885 Dec 21 04:06:28.457033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 214/446] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:28 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:28.466626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-00649311-ac0d-4f36-aa1c-764297f0f02b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:28.467308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-00649311-ac0d-4f36-aa1c-764297f0f02b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:28.475229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-00649311-ac0d-4f36-aa1c-764297f0f02b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:28.475678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-00649311-ac0d-4f36-aa1c-764297f0f02b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:28.476503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-00649311-ac0d-4f36-aa1c-764297f0f02b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:28.476987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-00649311-ac0d-4f36-aa1c-764297f0f02b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:28.690358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-00649311-ac0d-4f36-aa1c-764297f0f02b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:28.700599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-00649311-ac0d-4f36-aa1c-764297f0f02b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.242712 Dec 21 04:06:28.701201 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 215/447] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:28 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:28.765920 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d7a57ac1-868a-424c-8c01-2591ad16b132 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:28.766581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d7a57ac1-868a-424c-8c01-2591ad16b132 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:28.774621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d7a57ac1-868a-424c-8c01-2591ad16b132 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:28.775162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d7a57ac1-868a-424c-8c01-2591ad16b132 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:28.775992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d7a57ac1-868a-424c-8c01-2591ad16b132 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:28.776486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d7a57ac1-868a-424c-8c01-2591ad16b132 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:28.998227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d7a57ac1-868a-424c-8c01-2591ad16b132 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:29.012899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d7a57ac1-868a-424c-8c01-2591ad16b132 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:29.019405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d7a57ac1-868a-424c-8c01-2591ad16b132 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:29.020535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d7a57ac1-868a-424c-8c01-2591ad16b132 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1724 microversion: 2.20 time: 0.263708 Dec 21 04:06:29.021113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 216/448] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:28 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:06:29.479842 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-56d47458-8ea5-4d8e-a2e3-d222601900c4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:29.480510 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-56d47458-8ea5-4d8e-a2e3-d222601900c4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:29.489566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56d47458-8ea5-4d8e-a2e3-d222601900c4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:29.490145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56d47458-8ea5-4d8e-a2e3-d222601900c4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:29.491151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56d47458-8ea5-4d8e-a2e3-d222601900c4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:29.491727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56d47458-8ea5-4d8e-a2e3-d222601900c4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:29.713757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-56d47458-8ea5-4d8e-a2e3-d222601900c4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:29.722777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-56d47458-8ea5-4d8e-a2e3-d222601900c4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.252636 Dec 21 04:06:29.723926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 217/449] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:29 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:29.733498 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-70cf0611-814f-4e62-bb72-4133bb805210 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:29.734157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-70cf0611-814f-4e62-bb72-4133bb805210 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:29.742710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70cf0611-814f-4e62-bb72-4133bb805210 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:29.743311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70cf0611-814f-4e62-bb72-4133bb805210 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:29.744198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70cf0611-814f-4e62-bb72-4133bb805210 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:29.744790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70cf0611-814f-4e62-bb72-4133bb805210 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:29.963715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-70cf0611-814f-4e62-bb72-4133bb805210 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:29.976182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-70cf0611-814f-4e62-bb72-4133bb805210 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.250895 Dec 21 04:06:29.977327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 218/450] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:29 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:30.045294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-09ee32b4-1a5f-4a67-85e6-6e7efdbbc7cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:30.045959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-09ee32b4-1a5f-4a67-85e6-6e7efdbbc7cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:30.054010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09ee32b4-1a5f-4a67-85e6-6e7efdbbc7cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:30.054512 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09ee32b4-1a5f-4a67-85e6-6e7efdbbc7cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:30.055390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09ee32b4-1a5f-4a67-85e6-6e7efdbbc7cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:30.055885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09ee32b4-1a5f-4a67-85e6-6e7efdbbc7cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:30.285799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-09ee32b4-1a5f-4a67-85e6-6e7efdbbc7cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:30.300173 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-09ee32b4-1a5f-4a67-85e6-6e7efdbbc7cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:30.307058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-09ee32b4-1a5f-4a67-85e6-6e7efdbbc7cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:30.308252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-09ee32b4-1a5f-4a67-85e6-6e7efdbbc7cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1745 microversion: 2.20 time: 0.272674 Dec 21 04:06:30.308840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 219/451] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:30 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1745 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:06:30.746748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b8d28518-ca07-4199-aabe-15885a9c6543 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:30.747440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b8d28518-ca07-4199-aabe-15885a9c6543 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:30.756427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b8d28518-ca07-4199-aabe-15885a9c6543 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:30.756951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b8d28518-ca07-4199-aabe-15885a9c6543 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:30.757770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b8d28518-ca07-4199-aabe-15885a9c6543 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:30.758257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b8d28518-ca07-4199-aabe-15885a9c6543 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:30.980471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b8d28518-ca07-4199-aabe-15885a9c6543 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:30.990893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b8d28518-ca07-4199-aabe-15885a9c6543 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.253845 Dec 21 04:06:30.991543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 220/452] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:30 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:31.001211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-177b7839-e51f-4b2b-82f3-bd2c17af2d36 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:31.001805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-177b7839-e51f-4b2b-82f3-bd2c17af2d36 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:31.009657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-177b7839-e51f-4b2b-82f3-bd2c17af2d36 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:31.010160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-177b7839-e51f-4b2b-82f3-bd2c17af2d36 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:31.011008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-177b7839-e51f-4b2b-82f3-bd2c17af2d36 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:31.011497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-177b7839-e51f-4b2b-82f3-bd2c17af2d36 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:31.231504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-177b7839-e51f-4b2b-82f3-bd2c17af2d36 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:31.241732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-177b7839-e51f-4b2b-82f3-bd2c17af2d36 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.249193 Dec 21 04:06:31.242324 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 221/453] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:30 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:31.334003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a51efd63-94d8-4982-b607-aa35ccf2c1f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:31.334663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a51efd63-94d8-4982-b607-aa35ccf2c1f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:31.342549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a51efd63-94d8-4982-b607-aa35ccf2c1f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:31.343093 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a51efd63-94d8-4982-b607-aa35ccf2c1f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:31.343905 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a51efd63-94d8-4982-b607-aa35ccf2c1f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:31.344402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a51efd63-94d8-4982-b607-aa35ccf2c1f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:31.571715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a51efd63-94d8-4982-b607-aa35ccf2c1f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:31.587728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a51efd63-94d8-4982-b607-aa35ccf2c1f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:31.594396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a51efd63-94d8-4982-b607-aa35ccf2c1f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:31.595643 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a51efd63-94d8-4982-b607-aa35ccf2c1f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1745 microversion: 2.20 time: 0.271155 Dec 21 04:06:31.596437 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 222/454] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:31 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1745 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:06:32.014154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5b12bbdc-2f1c-4d86-83ca-9ac81236c8bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:32.014820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5b12bbdc-2f1c-4d86-83ca-9ac81236c8bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:32.023219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b12bbdc-2f1c-4d86-83ca-9ac81236c8bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:32.023729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b12bbdc-2f1c-4d86-83ca-9ac81236c8bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:32.024562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b12bbdc-2f1c-4d86-83ca-9ac81236c8bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:32.025052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b12bbdc-2f1c-4d86-83ca-9ac81236c8bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:32.255773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5b12bbdc-2f1c-4d86-83ca-9ac81236c8bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:32.264900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5b12bbdc-2f1c-4d86-83ca-9ac81236c8bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.259960 Dec 21 04:06:32.265438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 223/455] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:32 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:32.275676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d901a12c-847e-4bc3-a601-191b7e8ae66b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:32.276333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d901a12c-847e-4bc3-a601-191b7e8ae66b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:32.283699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d901a12c-847e-4bc3-a601-191b7e8ae66b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:32.284204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d901a12c-847e-4bc3-a601-191b7e8ae66b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:32.285035 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d901a12c-847e-4bc3-a601-191b7e8ae66b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:32.286156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d901a12c-847e-4bc3-a601-191b7e8ae66b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:32.513320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d901a12c-847e-4bc3-a601-191b7e8ae66b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:32.523799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d901a12c-847e-4bc3-a601-191b7e8ae66b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.257317 Dec 21 04:06:32.524401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 224/456] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:32 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:32.620950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3fc23a4c-cb3d-4d93-a36c-d76f5e5ae05c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:32.621613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3fc23a4c-cb3d-4d93-a36c-d76f5e5ae05c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:32.630291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3fc23a4c-cb3d-4d93-a36c-d76f5e5ae05c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:32.630801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3fc23a4c-cb3d-4d93-a36c-d76f5e5ae05c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:32.631660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3fc23a4c-cb3d-4d93-a36c-d76f5e5ae05c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:32.632155 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3fc23a4c-cb3d-4d93-a36c-d76f5e5ae05c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:32.864870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3fc23a4c-cb3d-4d93-a36c-d76f5e5ae05c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:32.880114 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3fc23a4c-cb3d-4d93-a36c-d76f5e5ae05c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:32.887066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3fc23a4c-cb3d-4d93-a36c-d76f5e5ae05c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:32.888318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3fc23a4c-cb3d-4d93-a36c-d76f5e5ae05c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1745 microversion: 2.20 time: 0.277002 Dec 21 04:06:32.888915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 225/457] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:32 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1745 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:06:32.956125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-a45416c9-fb87-4764-a021-ed7849062ec6 req-f87ad0c7-cf14-4a62-b92d-c9c50492fcbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c04726-583d-4c58-82b1-5baccee7c4a7", "name": "network-vif-plugged", "status": "completed", "tag": "499c69ca-3c31-461f-a533-f5bccf8a38fe"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:32.962873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:32.962873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:32.971898 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-a45416c9-fb87-4764-a021-ed7849062ec6 req-f87ad0c7-cf14-4a62-b92d-c9c50492fcbc service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:32.972434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-a45416c9-fb87-4764-a021-ed7849062ec6 req-f87ad0c7-cf14-4a62-b92d-c9c50492fcbc service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:32.994570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-a45416c9-fb87-4764-a021-ed7849062ec6 req-f87ad0c7-cf14-4a62-b92d-c9c50492fcbc service nova] Creating event network-vif-plugged:499c69ca-3c31-461f-a533-f5bccf8a38fe for instance 56c04726-583d-4c58-82b1-5baccee7c4a7 on hv-cinder-73306 Dec 21 04:06:33.000165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-a45416c9-fb87-4764-a021-ed7849062ec6 req-f87ad0c7-cf14-4a62-b92d-c9c50492fcbc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052907 Dec 21 04:06:33.001009 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 226/458] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:32 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:06:33.289480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-040433a4-faf0-496c-b2c1-192cb64f95c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:33.290894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-040433a4-faf0-496c-b2c1-192cb64f95c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:33.299510 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-040433a4-faf0-496c-b2c1-192cb64f95c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:33.300285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-040433a4-faf0-496c-b2c1-192cb64f95c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:33.301397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-040433a4-faf0-496c-b2c1-192cb64f95c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:33.302152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-040433a4-faf0-496c-b2c1-192cb64f95c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:33.635054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-040433a4-faf0-496c-b2c1-192cb64f95c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:33.646597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-040433a4-faf0-496c-b2c1-192cb64f95c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.366665 Dec 21 04:06:33.650368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 227/459] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:33 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:33.663449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-30cac508-a531-4603-a139-8c561fbef9c4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:33.664196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-30cac508-a531-4603-a139-8c561fbef9c4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:33.672260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30cac508-a531-4603-a139-8c561fbef9c4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:33.672785 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30cac508-a531-4603-a139-8c561fbef9c4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:33.673590 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30cac508-a531-4603-a139-8c561fbef9c4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:33.674080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30cac508-a531-4603-a139-8c561fbef9c4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:33.900693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-30cac508-a531-4603-a139-8c561fbef9c4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:33.910051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-30cac508-a531-4603-a139-8c561fbef9c4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.261461 Dec 21 04:06:33.911364 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 228/460] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:33 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:33.921205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-41ef4ab0-29d2-4d7f-b504-f9793c895007 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:33.929716 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41ef4ab0-29d2-4d7f-b504-f9793c895007 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:33.930231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41ef4ab0-29d2-4d7f-b504-f9793c895007 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:34.006692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-41ef4ab0-29d2-4d7f-b504-f9793c895007 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Going to try to stop instance {{(pid=94298) force_stop /opt/stack/nova/nova/compute/api.py:2576}} Dec 21 04:06:34.021984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] validate_networks() for [('b2a3a343-ad64-49b0-b882-98a263ddf1dc', None, None, None)] {{(pid=94299) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:06:34.096136 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-41ef4ab0-29d2-4d7f-b504-f9793c895007 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 202 len: 0 microversion: 2.1 time: 0.183394 Dec 21 04:06:34.096960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 229/461] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:33 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:06:34.108504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0f7af068-f05d-4cfa-8e07-71ca80e3c84d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:34.109289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0f7af068-f05d-4cfa-8e07-71ca80e3c84d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:34.128771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f7af068-f05d-4cfa-8e07-71ca80e3c84d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:34.129730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f7af068-f05d-4cfa-8e07-71ca80e3c84d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:34.130583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f7af068-f05d-4cfa-8e07-71ca80e3c84d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:34.131107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f7af068-f05d-4cfa-8e07-71ca80e3c84d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:34.364565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0f7af068-f05d-4cfa-8e07-71ca80e3c84d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:34.380821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0f7af068-f05d-4cfa-8e07-71ca80e3c84d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:34.387446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0f7af068-f05d-4cfa-8e07-71ca80e3c84d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:34.388668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0f7af068-f05d-4cfa-8e07-71ca80e3c84d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1745 microversion: 2.20 time: 0.290691 Dec 21 04:06:34.389260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 230/462] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:34 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1745 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:34.399002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ca7dd55f-9c06-458a-8a26-4a7eb238da5f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:34.399765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ca7dd55f-9c06-458a-8a26-4a7eb238da5f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:34.408478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca7dd55f-9c06-458a-8a26-4a7eb238da5f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:34.408985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca7dd55f-9c06-458a-8a26-4a7eb238da5f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:34.409830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca7dd55f-9c06-458a-8a26-4a7eb238da5f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:34.410328 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca7dd55f-9c06-458a-8a26-4a7eb238da5f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:34.619301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Flavor limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:06:34.619861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Image limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:06:34.620466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Flavor pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:06:34.620992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Image pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:06:34.621554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:06:34.631606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:34.632118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:34.632984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:34.633472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:34.653900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Getting quotas for project 012f21126d7d455391ef888198a0925c. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:06:34.658696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Getting quotas for user ce6a4d0576b74b53a97b6513edaa6ecf and project 012f21126d7d455391ef888198a0925c. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:06:34.672335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Going to run 1 instances... {{(pid=94299) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:06:34.675002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:06:34.728780 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-19ae97b5-d44e-43ef-8f08-a9664b1dbf8a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.606492 Dec 21 04:06:34.729811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 233/463] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:06:22 2020] POST /compute/v2.1/servers => generated 380 bytes in 12608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 21 04:06:34.741418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1e8f7d7d-b94d-447d-b4b3-c0e4fe7dd578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:34.743483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1e8f7d7d-b94d-447d-b4b3-c0e4fe7dd578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:34.751833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1e8f7d7d-b94d-447d-b4b3-c0e4fe7dd578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:34.752337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1e8f7d7d-b94d-447d-b4b3-c0e4fe7dd578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:34.753181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1e8f7d7d-b94d-447d-b4b3-c0e4fe7dd578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:34.753672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1e8f7d7d-b94d-447d-b4b3-c0e4fe7dd578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:34.921593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ca7dd55f-9c06-458a-8a26-4a7eb238da5f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:34.941814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ca7dd55f-9c06-458a-8a26-4a7eb238da5f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.551257 Dec 21 04:06:34.943233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 231/464] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:34 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:34.960551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-62d26e9e-c53f-4159-8f73-04524606e624 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:34.961319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-62d26e9e-c53f-4159-8f73-04524606e624 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:35.043559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1e8f7d7d-b94d-447d-b4b3-c0e4fe7dd578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:35.058437 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1e8f7d7d-b94d-447d-b4b3-c0e4fe7dd578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.327520 Dec 21 04:06:35.059665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 234/465] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:34 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:35.079908 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e3040728-6248-4daf-aabb-6612cec87092 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:35.080806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e3040728-6248-4daf-aabb-6612cec87092 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:35.084102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-62d26e9e-c53f-4159-8f73-04524606e624 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:35.090067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3040728-6248-4daf-aabb-6612cec87092 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:35.090803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3040728-6248-4daf-aabb-6612cec87092 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:35.091908 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3040728-6248-4daf-aabb-6612cec87092 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:35.092598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3040728-6248-4daf-aabb-6612cec87092 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:35.093202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-62d26e9e-c53f-4159-8f73-04524606e624 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1214 microversion: 2.1 time: 0.148622 Dec 21 04:06:35.093824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 232/466] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:34 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:35.335042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e3040728-6248-4daf-aabb-6612cec87092 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:35.344751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e3040728-6248-4daf-aabb-6612cec87092 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.275767 Dec 21 04:06:35.345447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 235/467] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:35 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:35.419684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fc0a255b-5ebd-4005-bcca-e72c4c4e021a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:35.420338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fc0a255b-5ebd-4005-bcca-e72c4c4e021a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:35.430608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc0a255b-5ebd-4005-bcca-e72c4c4e021a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:35.431167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc0a255b-5ebd-4005-bcca-e72c4c4e021a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:35.432066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc0a255b-5ebd-4005-bcca-e72c4c4e021a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:35.433155 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc0a255b-5ebd-4005-bcca-e72c4c4e021a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:35.716631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fc0a255b-5ebd-4005-bcca-e72c4c4e021a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:35.749141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fc0a255b-5ebd-4005-bcca-e72c4c4e021a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:35.758691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fc0a255b-5ebd-4005-bcca-e72c4c4e021a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:35.760777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fc0a255b-5ebd-4005-bcca-e72c4c4e021a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1740 microversion: 2.20 time: 0.351328 Dec 21 04:06:35.761660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 233/468] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:35 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:35.967170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d101eef3-95bf-4d3c-8239-188064635276 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:35.967851 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d101eef3-95bf-4d3c-8239-188064635276 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:35.976854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d101eef3-95bf-4d3c-8239-188064635276 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:35.977367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d101eef3-95bf-4d3c-8239-188064635276 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:35.978305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d101eef3-95bf-4d3c-8239-188064635276 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:35.978809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d101eef3-95bf-4d3c-8239-188064635276 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:36.084013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-73df8658-10e7-46c3-b137-9b0951d98159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:36.084744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-73df8658-10e7-46c3-b137-9b0951d98159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:36.095456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73df8658-10e7-46c3-b137-9b0951d98159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:36.095972 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73df8658-10e7-46c3-b137-9b0951d98159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:36.096836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73df8658-10e7-46c3-b137-9b0951d98159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:36.097338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73df8658-10e7-46c3-b137-9b0951d98159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:36.222487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d101eef3-95bf-4d3c-8239-188064635276 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:36.237182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d101eef3-95bf-4d3c-8239-188064635276 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.280075 Dec 21 04:06:36.248852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 236/469] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:35 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:36.253905 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cbbd0e10-fb87-4675-bf19-96001e3668f2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:36.255492 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cbbd0e10-fb87-4675-bf19-96001e3668f2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:36.264048 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbbd0e10-fb87-4675-bf19-96001e3668f2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:36.264568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbbd0e10-fb87-4675-bf19-96001e3668f2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:36.265438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbbd0e10-fb87-4675-bf19-96001e3668f2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:36.266147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbbd0e10-fb87-4675-bf19-96001e3668f2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:36.372075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-73df8658-10e7-46c3-b137-9b0951d98159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:36.383498 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-73df8658-10e7-46c3-b137-9b0951d98159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.309399 Dec 21 04:06:36.391797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 234/470] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:36 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:36.410273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-96915db4-88d1-438f-9619-d5f9c2d9139b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:36.410974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-96915db4-88d1-438f-9619-d5f9c2d9139b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:36.420053 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-96915db4-88d1-438f-9619-d5f9c2d9139b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:36.420571 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-96915db4-88d1-438f-9619-d5f9c2d9139b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:36.421302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-96915db4-88d1-438f-9619-d5f9c2d9139b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:36.422329 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-96915db4-88d1-438f-9619-d5f9c2d9139b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:36.439473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cbbd0e10-fb87-4675-bf19-96001e3668f2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:36.458847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cbbd0e10-fb87-4675-bf19-96001e3668f2 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1266 microversion: 2.1 time: 0.215267 Dec 21 04:06:36.463564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 237/471] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:36 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:36.687487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-96915db4-88d1-438f-9619-d5f9c2d9139b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:36.697667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-96915db4-88d1-438f-9619-d5f9c2d9139b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.300733 Dec 21 04:06:36.698325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 235/472] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:36 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:36.796184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c76d6dc8-0d1d-41c6-b396-c0fecb4da0ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:36.797088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c76d6dc8-0d1d-41c6-b396-c0fecb4da0ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:36.808720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c76d6dc8-0d1d-41c6-b396-c0fecb4da0ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:36.809231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c76d6dc8-0d1d-41c6-b396-c0fecb4da0ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:36.810077 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c76d6dc8-0d1d-41c6-b396-c0fecb4da0ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:36.812288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c76d6dc8-0d1d-41c6-b396-c0fecb4da0ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:37.218153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c76d6dc8-0d1d-41c6-b396-c0fecb4da0ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:37.236982 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c76d6dc8-0d1d-41c6-b396-c0fecb4da0ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:37.245357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c76d6dc8-0d1d-41c6-b396-c0fecb4da0ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:37.247008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c76d6dc8-0d1d-41c6-b396-c0fecb4da0ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1740 microversion: 2.20 time: 0.468821 Dec 21 04:06:37.247585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 238/473] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:36 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1740 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:37.263281 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-eceee6f5-b01c-44d2-a1b6-0bb494384e29 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:37.264167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-eceee6f5-b01c-44d2-a1b6-0bb494384e29 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:37.274553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eceee6f5-b01c-44d2-a1b6-0bb494384e29 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:37.275314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eceee6f5-b01c-44d2-a1b6-0bb494384e29 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:37.276304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eceee6f5-b01c-44d2-a1b6-0bb494384e29 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:37.276945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eceee6f5-b01c-44d2-a1b6-0bb494384e29 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:37.409668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e49a2395-0d61-460b-bbd7-d684c589b813 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:37.411098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e49a2395-0d61-460b-bbd7-d684c589b813 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:37.423973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e49a2395-0d61-460b-bbd7-d684c589b813 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:37.425049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e49a2395-0d61-460b-bbd7-d684c589b813 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:37.427500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e49a2395-0d61-460b-bbd7-d684c589b813 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:37.428192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e49a2395-0d61-460b-bbd7-d684c589b813 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:37.700582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e49a2395-0d61-460b-bbd7-d684c589b813 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:37.711773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e49a2395-0d61-460b-bbd7-d684c589b813 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1265 microversion: 2.1 time: 0.314132 Dec 21 04:06:37.712655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 239/474] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:37 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:37.723694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a19b4816-e365-478f-a652-860d36f62d58 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:37.724483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a19b4816-e365-478f-a652-860d36f62d58 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:37.733360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a19b4816-e365-478f-a652-860d36f62d58 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:37.733876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a19b4816-e365-478f-a652-860d36f62d58 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:37.734872 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a19b4816-e365-478f-a652-860d36f62d58 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:37.735391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a19b4816-e365-478f-a652-860d36f62d58 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:37.744710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-eceee6f5-b01c-44d2-a1b6-0bb494384e29 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:37.761373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-eceee6f5-b01c-44d2-a1b6-0bb494384e29 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.508141 Dec 21 04:06:37.767796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 236/475] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:37 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:37.789888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-37c0b39b-244a-467e-afa2-480a229e4ce4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:37.792019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-37c0b39b-244a-467e-afa2-480a229e4ce4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:37.807543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-37c0b39b-244a-467e-afa2-480a229e4ce4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:37.808063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-37c0b39b-244a-467e-afa2-480a229e4ce4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:37.808922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-37c0b39b-244a-467e-afa2-480a229e4ce4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:37.809421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-37c0b39b-244a-467e-afa2-480a229e4ce4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:37.943102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a19b4816-e365-478f-a652-860d36f62d58 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:37.960118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a19b4816-e365-478f-a652-860d36f62d58 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1272 microversion: 2.1 time: 0.245825 Dec 21 04:06:37.961250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 240/476] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:37 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:38.173610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-37c0b39b-244a-467e-afa2-480a229e4ce4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:38.223814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-37c0b39b-244a-467e-afa2-480a229e4ce4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.454476 Dec 21 04:06:38.230752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 237/477] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:37 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:38.275059 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c67f65a2-8d70-4545-8e39-9669b082fdee tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:38.283876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c67f65a2-8d70-4545-8e39-9669b082fdee tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:38.305900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c67f65a2-8d70-4545-8e39-9669b082fdee tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:38.306963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c67f65a2-8d70-4545-8e39-9669b082fdee tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:38.314683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c67f65a2-8d70-4545-8e39-9669b082fdee tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:38.316010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c67f65a2-8d70-4545-8e39-9669b082fdee tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:38.658135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c67f65a2-8d70-4545-8e39-9669b082fdee tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:38.676975 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c67f65a2-8d70-4545-8e39-9669b082fdee tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:38.684653 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c67f65a2-8d70-4545-8e39-9669b082fdee tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:38.685945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c67f65a2-8d70-4545-8e39-9669b082fdee tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1740 microversion: 2.20 time: 0.422292 Dec 21 04:06:38.686548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 241/478] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:38 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1740 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:38.736055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1c9506b3-fec7-44ec-a7fc-a9a2aa54b342 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:38.736893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1c9506b3-fec7-44ec-a7fc-a9a2aa54b342 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:38.747108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1c9506b3-fec7-44ec-a7fc-a9a2aa54b342 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:38.747756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1c9506b3-fec7-44ec-a7fc-a9a2aa54b342 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:38.748722 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1c9506b3-fec7-44ec-a7fc-a9a2aa54b342 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:38.749378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1c9506b3-fec7-44ec-a7fc-a9a2aa54b342 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:38.790676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1b5b6caa-791c-45ff-a0c0-657c7ea621b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:38.791652 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1b5b6caa-791c-45ff-a0c0-657c7ea621b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:38.816635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b5b6caa-791c-45ff-a0c0-657c7ea621b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:38.819717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b5b6caa-791c-45ff-a0c0-657c7ea621b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:38.822675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b5b6caa-791c-45ff-a0c0-657c7ea621b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:38.824394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b5b6caa-791c-45ff-a0c0-657c7ea621b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:39.200445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1b5b6caa-791c-45ff-a0c0-657c7ea621b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:39.213346 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1b5b6caa-791c-45ff-a0c0-657c7ea621b9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.432937 Dec 21 04:06:39.214626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 242/479] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:38 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:39.225398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-56d98f91-54ec-45d6-a7f8-138347564b5f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:39.226168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-56d98f91-54ec-45d6-a7f8-138347564b5f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:39.236260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56d98f91-54ec-45d6-a7f8-138347564b5f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:39.237108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56d98f91-54ec-45d6-a7f8-138347564b5f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:39.250241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56d98f91-54ec-45d6-a7f8-138347564b5f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:39.250712 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1c9506b3-fec7-44ec-a7fc-a9a2aa54b342 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:39.251055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56d98f91-54ec-45d6-a7f8-138347564b5f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:39.285367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1c9506b3-fec7-44ec-a7fc-a9a2aa54b342 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1448 microversion: 2.1 time: 0.559047 Dec 21 04:06:39.295978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 238/480] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:38 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1448 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:39.320250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8f9a76bb-cdba-476e-ad54-0f03c36074eb tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:39.321585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8f9a76bb-cdba-476e-ad54-0f03c36074eb tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:39.334566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f9a76bb-cdba-476e-ad54-0f03c36074eb tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:39.335699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f9a76bb-cdba-476e-ad54-0f03c36074eb tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:39.336556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f9a76bb-cdba-476e-ad54-0f03c36074eb tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:39.337710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f9a76bb-cdba-476e-ad54-0f03c36074eb tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:39.653054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-56d98f91-54ec-45d6-a7f8-138347564b5f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:39.663865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-56d98f91-54ec-45d6-a7f8-138347564b5f tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1314 microversion: 2.1 time: 0.447992 Dec 21 04:06:39.664477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 243/481] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:39 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:39.674890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5ff50bcd-92d4-4f51-97ce-2c6a35bca7d7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:39.675611 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5ff50bcd-92d4-4f51-97ce-2c6a35bca7d7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:39.684599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5ff50bcd-92d4-4f51-97ce-2c6a35bca7d7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:39.685128 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5ff50bcd-92d4-4f51-97ce-2c6a35bca7d7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:39.685993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5ff50bcd-92d4-4f51-97ce-2c6a35bca7d7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:39.686566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5ff50bcd-92d4-4f51-97ce-2c6a35bca7d7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:39.852908 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8f9a76bb-cdba-476e-ad54-0f03c36074eb tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:39.872178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8f9a76bb-cdba-476e-ad54-0f03c36074eb tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.575063 Dec 21 04:06:39.890377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 239/482] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:39 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:39.904580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-36ebdf82-3c31-4151-b0dc-a1e46f4df932 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:39.905256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-36ebdf82-3c31-4151-b0dc-a1e46f4df932 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:39.914790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-36ebdf82-3c31-4151-b0dc-a1e46f4df932 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:39.915368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-36ebdf82-3c31-4151-b0dc-a1e46f4df932 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:39.916232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-36ebdf82-3c31-4151-b0dc-a1e46f4df932 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:39.916741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-36ebdf82-3c31-4151-b0dc-a1e46f4df932 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:40.079449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5ff50bcd-92d4-4f51-97ce-2c6a35bca7d7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:40.105435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5ff50bcd-92d4-4f51-97ce-2c6a35bca7d7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1448 microversion: 2.1 time: 0.439759 Dec 21 04:06:40.108096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 244/483] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:39 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1448 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:40.142581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cdb26824-7b5e-47b7-80ba-1e0adaa7181a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Action: 'create', calling method: .version_select at 0x7f2bb91250d0>, body: {"pool": null} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:40.552647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-36ebdf82-3c31-4151-b0dc-a1e46f4df932 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:40.587156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-36ebdf82-3c31-4151-b0dc-a1e46f4df932 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:40.594732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-36ebdf82-3c31-4151-b0dc-a1e46f4df932 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:40.596076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-36ebdf82-3c31-4151-b0dc-a1e46f4df932 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1740 microversion: 2.20 time: 0.704560 Dec 21 04:06:40.596839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 240/484] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:39 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1740 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:40.621637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3fd76478-5624-4cef-a275-c7be185f06db tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:40.622350 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3fd76478-5624-4cef-a275-c7be185f06db tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:40.630888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3fd76478-5624-4cef-a275-c7be185f06db tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:40.631442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3fd76478-5624-4cef-a275-c7be185f06db tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:40.632365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3fd76478-5624-4cef-a275-c7be185f06db tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:40.632857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3fd76478-5624-4cef-a275-c7be185f06db tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:41.396408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3fd76478-5624-4cef-a275-c7be185f06db tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:41.410433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3fd76478-5624-4cef-a275-c7be185f06db tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.799113 Dec 21 04:06:41.419086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 241/485] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:40 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:41.438710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-84e30350-189b-41cf-b169-b56c4cd6cd71 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:41.477003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-84e30350-189b-41cf-b169-b56c4cd6cd71 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:41.494530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-84e30350-189b-41cf-b169-b56c4cd6cd71 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:41.503144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-84e30350-189b-41cf-b169-b56c4cd6cd71 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:41.504680 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-84e30350-189b-41cf-b169-b56c4cd6cd71 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:41.505589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-84e30350-189b-41cf-b169-b56c4cd6cd71 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:42.045022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-84e30350-189b-41cf-b169-b56c4cd6cd71 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:42.074312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-84e30350-189b-41cf-b169-b56c4cd6cd71 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1314 microversion: 2.1 time: 0.653105 Dec 21 04:06:42.075300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 242/486] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:41 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:42.085791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6961994e-b253-498a-b931-b51a0136765e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:42.086577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6961994e-b253-498a-b931-b51a0136765e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:42.098080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6961994e-b253-498a-b931-b51a0136765e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:42.098996 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6961994e-b253-498a-b931-b51a0136765e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:42.109874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6961994e-b253-498a-b931-b51a0136765e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:42.110589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6961994e-b253-498a-b931-b51a0136765e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:42.889745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6961994e-b253-498a-b931-b51a0136765e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:42.900471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6961994e-b253-498a-b931-b51a0136765e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.824050 Dec 21 04:06:42.901003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 243/487] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:42 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:42.912486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-772ddf75-34d4-4be1-8849-d153720b1b4e req-a558b45f-59ca-4320-8de0-309acbc45635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a33f9dfc-75d8-4a80-b4e2-9947b3442aa5", "tag": "71d5bad2-6b96-4104-9da5-9c317eff8175"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:42.920439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.920439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:42.932004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-772ddf75-34d4-4be1-8849-d153720b1b4e req-a558b45f-59ca-4320-8de0-309acbc45635 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:42.932776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-772ddf75-34d4-4be1-8849-d153720b1b4e req-a558b45f-59ca-4320-8de0-309acbc45635 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:42.953844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-772ddf75-34d4-4be1-8849-d153720b1b4e req-a558b45f-59ca-4320-8de0-309acbc45635 service nova] Creating event network-changed:71d5bad2-6b96-4104-9da5-9c317eff8175 for instance a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 on hv-cinder-73306 Dec 21 04:06:42.961069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-772ddf75-34d4-4be1-8849-d153720b1b4e req-a558b45f-59ca-4320-8de0-309acbc45635 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058290 Dec 21 04:06:42.962521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 244/488] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:42 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:42.975244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-72438bd9-4500-4f24-96ac-57af0f2258fb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:42.976989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-72438bd9-4500-4f24-96ac-57af0f2258fb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:42.985634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-72438bd9-4500-4f24-96ac-57af0f2258fb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:42.986720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-72438bd9-4500-4f24-96ac-57af0f2258fb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:42.987794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-72438bd9-4500-4f24-96ac-57af0f2258fb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:42.989315 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-72438bd9-4500-4f24-96ac-57af0f2258fb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:43.146362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cdb26824-7b5e-47b7-80ba-1e0adaa7181a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.024057 Dec 21 04:06:43.147119 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 245/489] 10.222.0.16 () {60 vars in 1160 bytes} [Mon Dec 21 04:06:40 2020] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:06:43.162540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0f6ba60d-a8f4-4ba4-9f49-9dda2c332c4d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:43.163560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0f6ba60d-a8f4-4ba4-9f49-9dda2c332c4d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:43.173282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f6ba60d-a8f4-4ba4-9f49-9dda2c332c4d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:43.174109 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f6ba60d-a8f4-4ba4-9f49-9dda2c332c4d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:43.175246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f6ba60d-a8f4-4ba4-9f49-9dda2c332c4d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:43.176528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f6ba60d-a8f4-4ba4-9f49-9dda2c332c4d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:43.534070 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0f6ba60d-a8f4-4ba4-9f49-9dda2c332c4d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "DELETE /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c/os-volume_attachments/40b0649d-a1a0-47a4-aac0-7ad90440a277" status: 202 len: 0 microversion: 2.1 time: 0.385290 Dec 21 04:06:43.534966 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 246/490] 10.222.0.16 () {58 vars in 1406 bytes} [Mon Dec 21 04:06:43 2020] DELETE /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c/os-volume_attachments/40b0649d-a1a0-47a4-aac0-7ad90440a277 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:06:43.547230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f70405f2-eb90-4a0a-addc-6fecb5f6754d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:43.555910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f70405f2-eb90-4a0a-addc-6fecb5f6754d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:43.565001 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f70405f2-eb90-4a0a-addc-6fecb5f6754d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:43.565826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f70405f2-eb90-4a0a-addc-6fecb5f6754d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:43.567363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f70405f2-eb90-4a0a-addc-6fecb5f6754d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:43.568053 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f70405f2-eb90-4a0a-addc-6fecb5f6754d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:43.713069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-72438bd9-4500-4f24-96ac-57af0f2258fb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:43.765413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-72438bd9-4500-4f24-96ac-57af0f2258fb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:43.795073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-72438bd9-4500-4f24-96ac-57af0f2258fb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:43.796745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-72438bd9-4500-4f24-96ac-57af0f2258fb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1740 microversion: 2.20 time: 0.832693 Dec 21 04:06:43.797469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 245/491] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:42 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1740 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:43.822026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a1e56b76-5ea0-4a1d-ad89-4bcbb615c481 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:43.829555 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a1e56b76-5ea0-4a1d-ad89-4bcbb615c481 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:43.841843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a1e56b76-5ea0-4a1d-ad89-4bcbb615c481 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:43.842656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a1e56b76-5ea0-4a1d-ad89-4bcbb615c481 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:43.843725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a1e56b76-5ea0-4a1d-ad89-4bcbb615c481 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:43.844401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a1e56b76-5ea0-4a1d-ad89-4bcbb615c481 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:43.968592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f70405f2-eb90-4a0a-addc-6fecb5f6754d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:43.983155 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f70405f2-eb90-4a0a-addc-6fecb5f6754d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.445153 Dec 21 04:06:43.984059 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 247/492] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:43 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:44.010294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5df7bfa3-4caa-41f4-a123-8c9f8f99313d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Action: 'action', calling method: .version_select at 0x7f2bb9dad598>, body: {"addFloatingIp": {"address": "172.27.0.182"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:44.011967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5df7bfa3-4caa-41f4-a123-8c9f8f99313d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:44.023496 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5df7bfa3-4caa-41f4-a123-8c9f8f99313d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:44.024304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5df7bfa3-4caa-41f4-a123-8c9f8f99313d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:44.025331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5df7bfa3-4caa-41f4-a123-8c9f8f99313d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:44.026616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5df7bfa3-4caa-41f4-a123-8c9f8f99313d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:44.115263 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5df7bfa3-4caa-41f4-a123-8c9f8f99313d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Acquired lock "refresh_cache-56c04726-583d-4c58-82b1-5baccee7c4a7" {{(pid=94299) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 21 04:06:44.773701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a1e56b76-5ea0-4a1d-ad89-4bcbb615c481 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:44.786888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a1e56b76-5ea0-4a1d-ad89-4bcbb615c481 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1314 microversion: 2.1 time: 0.988144 Dec 21 04:06:44.787847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 246/493] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:43 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:44.842165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f773dc0c-52ba-4852-8f5d-8790ee497d22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:44.844497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f773dc0c-52ba-4852-8f5d-8790ee497d22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:44.863811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f773dc0c-52ba-4852-8f5d-8790ee497d22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:44.865742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f773dc0c-52ba-4852-8f5d-8790ee497d22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:44.869971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f773dc0c-52ba-4852-8f5d-8790ee497d22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:44.870686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f773dc0c-52ba-4852-8f5d-8790ee497d22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:45.259011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f773dc0c-52ba-4852-8f5d-8790ee497d22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:45.273247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f773dc0c-52ba-4852-8f5d-8790ee497d22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.448882 Dec 21 04:06:45.274467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 247/494] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:44 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:45.284793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b623fe86-f305-4db6-83b6-0122ac9ce5ae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:45.286765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b623fe86-f305-4db6-83b6-0122ac9ce5ae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:45.295153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b623fe86-f305-4db6-83b6-0122ac9ce5ae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:45.296131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b623fe86-f305-4db6-83b6-0122ac9ce5ae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:45.297378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b623fe86-f305-4db6-83b6-0122ac9ce5ae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:45.298072 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b623fe86-f305-4db6-83b6-0122ac9ce5ae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:45.691104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b623fe86-f305-4db6-83b6-0122ac9ce5ae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:45.714954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b623fe86-f305-4db6-83b6-0122ac9ce5ae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:45.747232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b623fe86-f305-4db6-83b6-0122ac9ce5ae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:45.748668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b623fe86-f305-4db6-83b6-0122ac9ce5ae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1740 microversion: 2.20 time: 0.472745 Dec 21 04:06:45.749377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 248/495] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:45 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1740 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:45.759765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4b2c871c-4b71-48c2-9d68-5a65a51bd3af tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:45.760589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4b2c871c-4b71-48c2-9d68-5a65a51bd3af tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:45.770205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b2c871c-4b71-48c2-9d68-5a65a51bd3af tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:45.770885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b2c871c-4b71-48c2-9d68-5a65a51bd3af tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:45.771894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b2c871c-4b71-48c2-9d68-5a65a51bd3af tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:45.772501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b2c871c-4b71-48c2-9d68-5a65a51bd3af tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:46.242281 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4b2c871c-4b71-48c2-9d68-5a65a51bd3af tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:46.255483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4b2c871c-4b71-48c2-9d68-5a65a51bd3af tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.504641 Dec 21 04:06:46.256355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 249/496] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:45 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:46.266274 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-815cb3ac-ff24-425e-bc4e-c0e69ebc61a5 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:46.267534 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-815cb3ac-ff24-425e-bc4e-c0e69ebc61a5 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:46.276882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-815cb3ac-ff24-425e-bc4e-c0e69ebc61a5 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:46.277777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-815cb3ac-ff24-425e-bc4e-c0e69ebc61a5 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:46.278824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-815cb3ac-ff24-425e-bc4e-c0e69ebc61a5 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:46.279526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-815cb3ac-ff24-425e-bc4e-c0e69ebc61a5 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:46.568967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-815cb3ac-ff24-425e-bc4e-c0e69ebc61a5 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:46.578469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-815cb3ac-ff24-425e-bc4e-c0e69ebc61a5 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1314 microversion: 2.1 time: 0.320793 Dec 21 04:06:46.588955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 250/497] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:46 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:46.599188 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b7ddece7-c71d-4e46-ae34-247bccfa0e32 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:46.600091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b7ddece7-c71d-4e46-ae34-247bccfa0e32 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:46.608484 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7ddece7-c71d-4e46-ae34-247bccfa0e32 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:46.610678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7ddece7-c71d-4e46-ae34-247bccfa0e32 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:46.611727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7ddece7-c71d-4e46-ae34-247bccfa0e32 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:46.612373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7ddece7-c71d-4e46-ae34-247bccfa0e32 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:46.871373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b7ddece7-c71d-4e46-ae34-247bccfa0e32 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:46.881521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-5df7bfa3-4caa-41f4-a123-8c9f8f99313d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Building network info cache for instance {{(pid=94299) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 21 04:06:46.883812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b7ddece7-c71d-4e46-ae34-247bccfa0e32 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.293439 Dec 21 04:06:46.893900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 251/498] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:46 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:46.897640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-abff5207-28c3-41d1-97e4-6d6c79755d76 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:46.897640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-abff5207-28c3-41d1-97e4-6d6c79755d76 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:46.906486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abff5207-28c3-41d1-97e4-6d6c79755d76 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:46.907033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abff5207-28c3-41d1-97e4-6d6c79755d76 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:46.907929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abff5207-28c3-41d1-97e4-6d6c79755d76 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:46.908782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abff5207-28c3-41d1-97e4-6d6c79755d76 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:47.166543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-abff5207-28c3-41d1-97e4-6d6c79755d76 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:47.183931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-abff5207-28c3-41d1-97e4-6d6c79755d76 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:47.191187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-abff5207-28c3-41d1-97e4-6d6c79755d76 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:47.192734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-abff5207-28c3-41d1-97e4-6d6c79755d76 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1740 microversion: 2.20 time: 0.306912 Dec 21 04:06:47.193617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 252/499] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:46 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:47.204514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-11cd8040-dba9-43d7-bce7-843697480615 req-ff221455-f473-4a0a-a32d-4853e550e029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c04726-583d-4c58-82b1-5baccee7c4a7", "tag": "499c69ca-3c31-461f-a533-f5bccf8a38fe"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:47.213824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:47.213824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:47.224787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-11cd8040-dba9-43d7-bce7-843697480615 req-ff221455-f473-4a0a-a32d-4853e550e029 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:47.225304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-11cd8040-dba9-43d7-bce7-843697480615 req-ff221455-f473-4a0a-a32d-4853e550e029 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:47.246677 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-11cd8040-dba9-43d7-bce7-843697480615 req-ff221455-f473-4a0a-a32d-4853e550e029 service nova] Creating event network-changed:499c69ca-3c31-461f-a533-f5bccf8a38fe for instance 56c04726-583d-4c58-82b1-5baccee7c4a7 on hv-cinder-73306 Dec 21 04:06:47.253494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-11cd8040-dba9-43d7-bce7-843697480615 req-ff221455-f473-4a0a-a32d-4853e550e029 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056936 Dec 21 04:06:47.254512 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 253/500] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:47 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:47.287793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4574ff50-c8fa-46f3-a900-86967c664008 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:47.289359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4574ff50-c8fa-46f3-a900-86967c664008 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:47.299418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4574ff50-c8fa-46f3-a900-86967c664008 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:47.300284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4574ff50-c8fa-46f3-a900-86967c664008 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:47.301650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4574ff50-c8fa-46f3-a900-86967c664008 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:47.302486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4574ff50-c8fa-46f3-a900-86967c664008 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:47.998382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-5df7bfa3-4caa-41f4-a123-8c9f8f99313d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Updating instance_info_cache with network_info: [{"id": "499c69ca-3c31-461f-a533-f5bccf8a38fe", "address": "fa:16:3e:4b:9e:6f", "network": {"id": "013b4941-7458-42a2-bded-2718d1174ace", "bridge": "br-int", "label": "tempest-TestShelveInstance-518431990-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b07ec805977d456b9447a634af514cde", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap499c69ca-3c", "ovs_interfaceid": "499c69ca-3c31-461f-a533-f5bccf8a38fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94299) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 21 04:06:48.028719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5df7bfa3-4caa-41f4-a123-8c9f8f99313d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Releasing lock "refresh_cache-56c04726-583d-4c58-82b1-5baccee7c4a7" {{(pid=94299) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 21 04:06:48.031667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5df7bfa3-4caa-41f4-a123-8c9f8f99313d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "POST /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7/action" status: 202 len: 0 microversion: 2.1 time: 4.032338 Dec 21 04:06:48.032519 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 248/501] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:43 2020] POST /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7/action => generated 0 bytes in 4034 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 21 04:06:48.044727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dc4cfcf2-195b-4832-8530-ece3ba4b4a24 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:48.052015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dc4cfcf2-195b-4832-8530-ece3ba4b4a24 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:48.056178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4574ff50-c8fa-46f3-a900-86967c664008 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:48.071985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc4cfcf2-195b-4832-8530-ece3ba4b4a24 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:48.072943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc4cfcf2-195b-4832-8530-ece3ba4b4a24 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:48.075941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc4cfcf2-195b-4832-8530-ece3ba4b4a24 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:48.076708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc4cfcf2-195b-4832-8530-ece3ba4b4a24 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:48.083361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4574ff50-c8fa-46f3-a900-86967c664008 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.812369 Dec 21 04:06:48.083983 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 254/502] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:47 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:48.104486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c34b7203-9ecb-43cf-b5e3-7bdf1b66a4dc tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:48.105163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c34b7203-9ecb-43cf-b5e3-7bdf1b66a4dc tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:48.126803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c34b7203-9ecb-43cf-b5e3-7bdf1b66a4dc tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:48.126803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c34b7203-9ecb-43cf-b5e3-7bdf1b66a4dc tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:48.126803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c34b7203-9ecb-43cf-b5e3-7bdf1b66a4dc tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:48.126803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c34b7203-9ecb-43cf-b5e3-7bdf1b66a4dc tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:48.322565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dc4cfcf2-195b-4832-8530-ece3ba4b4a24 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Going to try to terminate instance {{(pid=94299) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:06:48.575432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dc4cfcf2-195b-4832-8530-ece3ba4b4a24 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "DELETE /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 204 len: 0 microversion: 2.1 time: 0.541201 Dec 21 04:06:48.576411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 249/503] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:06:48 2020] DELETE /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:06:48.591150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5d8fe755-5021-4ec5-bb11-7dbee444ac1b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:48.592024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5d8fe755-5021-4ec5-bb11-7dbee444ac1b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:48.601875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d8fe755-5021-4ec5-bb11-7dbee444ac1b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:48.607319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d8fe755-5021-4ec5-bb11-7dbee444ac1b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:48.608353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d8fe755-5021-4ec5-bb11-7dbee444ac1b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:48.608929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d8fe755-5021-4ec5-bb11-7dbee444ac1b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:48.669487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c34b7203-9ecb-43cf-b5e3-7bdf1b66a4dc tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:48.686008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c34b7203-9ecb-43cf-b5e3-7bdf1b66a4dc tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1314 microversion: 2.1 time: 0.590670 Dec 21 04:06:48.700117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 255/504] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:48 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:48.706404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bdbb18a6-5a73-4b8e-b9f7-56a93ecb56ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:48.707852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bdbb18a6-5a73-4b8e-b9f7-56a93ecb56ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:48.725719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bdbb18a6-5a73-4b8e-b9f7-56a93ecb56ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:48.726231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bdbb18a6-5a73-4b8e-b9f7-56a93ecb56ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:48.731183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bdbb18a6-5a73-4b8e-b9f7-56a93ecb56ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:48.731707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bdbb18a6-5a73-4b8e-b9f7-56a93ecb56ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:48.927022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5d8fe755-5021-4ec5-bb11-7dbee444ac1b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:48.965041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5d8fe755-5021-4ec5-bb11-7dbee444ac1b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.384308 Dec 21 04:06:48.965935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 250/505] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:48 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:48.978757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bf953871-5251-4af6-9702-c4f76977cb67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:48.983930 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bf953871-5251-4af6-9702-c4f76977cb67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:48.994230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf953871-5251-4af6-9702-c4f76977cb67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:48.995698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf953871-5251-4af6-9702-c4f76977cb67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:48.996762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf953871-5251-4af6-9702-c4f76977cb67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:48.997450 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf953871-5251-4af6-9702-c4f76977cb67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:49.189836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bdbb18a6-5a73-4b8e-b9f7-56a93ecb56ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:49.216442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bdbb18a6-5a73-4b8e-b9f7-56a93ecb56ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:49.224702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bdbb18a6-5a73-4b8e-b9f7-56a93ecb56ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:49.226495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bdbb18a6-5a73-4b8e-b9f7-56a93ecb56ce tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1740 microversion: 2.20 time: 0.533239 Dec 21 04:06:49.227425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 256/506] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:48 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1740 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:49.246822 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-43dfffd6-2d2c-4f03-9671-84a0906c040b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:49.249796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-43dfffd6-2d2c-4f03-9671-84a0906c040b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:49.264108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bf953871-5251-4af6-9702-c4f76977cb67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:49.271356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-43dfffd6-2d2c-4f03-9671-84a0906c040b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:49.272246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-43dfffd6-2d2c-4f03-9671-84a0906c040b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:49.273418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-43dfffd6-2d2c-4f03-9671-84a0906c040b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:49.273996 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-43dfffd6-2d2c-4f03-9671-84a0906c040b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:49.274322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bf953871-5251-4af6-9702-c4f76977cb67 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1515 microversion: 2.1 time: 0.307593 Dec 21 04:06:49.275084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 251/507] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:48 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1515 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:49.541397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-43dfffd6-2d2c-4f03-9671-84a0906c040b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:49.551609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-43dfffd6-2d2c-4f03-9671-84a0906c040b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.322802 Dec 21 04:06:49.552363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 257/508] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:49 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:49.716556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cf096a72-0d96-426b-86aa-6ecc9e3f91d3 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:49.717398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cf096a72-0d96-426b-86aa-6ecc9e3f91d3 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:49.726305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cf096a72-0d96-426b-86aa-6ecc9e3f91d3 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:49.726862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cf096a72-0d96-426b-86aa-6ecc9e3f91d3 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:49.727675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cf096a72-0d96-426b-86aa-6ecc9e3f91d3 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:49.728160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cf096a72-0d96-426b-86aa-6ecc9e3f91d3 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:49.963540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cf096a72-0d96-426b-86aa-6ecc9e3f91d3 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:49.972277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cf096a72-0d96-426b-86aa-6ecc9e3f91d3 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1314 microversion: 2.1 time: 0.268180 Dec 21 04:06:49.972870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 252/509] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:49 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:49.988974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-de22fab4-19cc-44b3-abb8-d5119fbb264f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:49.989636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-de22fab4-19cc-44b3-abb8-d5119fbb264f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:49.997481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de22fab4-19cc-44b3-abb8-d5119fbb264f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:49.997983 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de22fab4-19cc-44b3-abb8-d5119fbb264f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:49.998809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de22fab4-19cc-44b3-abb8-d5119fbb264f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:49.999347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de22fab4-19cc-44b3-abb8-d5119fbb264f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:50.215218 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-de22fab4-19cc-44b3-abb8-d5119fbb264f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:50.224565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-de22fab4-19cc-44b3-abb8-d5119fbb264f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.244837 Dec 21 04:06:50.225157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 258/510] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:49 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:50.251191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-918f04fa-c400-4b3d-92c3-be4a348b564a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:50.252190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-918f04fa-c400-4b3d-92c3-be4a348b564a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:50.261437 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-918f04fa-c400-4b3d-92c3-be4a348b564a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:50.261943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-918f04fa-c400-4b3d-92c3-be4a348b564a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:50.262781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-918f04fa-c400-4b3d-92c3-be4a348b564a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:50.263336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-918f04fa-c400-4b3d-92c3-be4a348b564a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:50.298471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-530289bf-8a36-4170-af10-90c38957ef19 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:50.299162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-530289bf-8a36-4170-af10-90c38957ef19 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:50.307516 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-530289bf-8a36-4170-af10-90c38957ef19 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:50.308021 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-530289bf-8a36-4170-af10-90c38957ef19 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:50.308881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-530289bf-8a36-4170-af10-90c38957ef19 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:50.309367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-530289bf-8a36-4170-af10-90c38957ef19 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:50.483267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-918f04fa-c400-4b3d-92c3-be4a348b564a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:50.502921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-918f04fa-c400-4b3d-92c3-be4a348b564a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:50.510129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-918f04fa-c400-4b3d-92c3-be4a348b564a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:50.511469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-918f04fa-c400-4b3d-92c3-be4a348b564a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1740 microversion: 2.20 time: 0.269637 Dec 21 04:06:50.512384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 253/511] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:50 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:50.555024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-530289bf-8a36-4170-af10-90c38957ef19 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:50.563941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-530289bf-8a36-4170-af10-90c38957ef19 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1515 microversion: 2.1 time: 0.274651 Dec 21 04:06:50.564535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 259/512] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:50 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1515 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:50.575493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f3909c54-1810-464e-8565-1db93c3d5b62 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:50.576174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f3909c54-1810-464e-8565-1db93c3d5b62 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:50.584299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3909c54-1810-464e-8565-1db93c3d5b62 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:50.584813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3909c54-1810-464e-8565-1db93c3d5b62 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:50.585650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3909c54-1810-464e-8565-1db93c3d5b62 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:50.586143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3909c54-1810-464e-8565-1db93c3d5b62 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:50.803975 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f3909c54-1810-464e-8565-1db93c3d5b62 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:50.813397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f3909c54-1810-464e-8565-1db93c3d5b62 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.247415 Dec 21 04:06:50.813998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 254/513] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:50 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:50.995308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e5a3ca73-1537-4c7b-a8cd-41d31c44de92 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:50.995974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e5a3ca73-1537-4c7b-a8cd-41d31c44de92 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:51.003834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5a3ca73-1537-4c7b-a8cd-41d31c44de92 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:51.004524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5a3ca73-1537-4c7b-a8cd-41d31c44de92 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:51.005358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5a3ca73-1537-4c7b-a8cd-41d31c44de92 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:51.005843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5a3ca73-1537-4c7b-a8cd-41d31c44de92 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:51.248433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-02fda798-822a-4bf8-8fe7-5ad614ee27a0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:51.249103 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-02fda798-822a-4bf8-8fe7-5ad614ee27a0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:51.258455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-02fda798-822a-4bf8-8fe7-5ad614ee27a0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:51.258959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-02fda798-822a-4bf8-8fe7-5ad614ee27a0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:51.259800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-02fda798-822a-4bf8-8fe7-5ad614ee27a0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:51.260284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-02fda798-822a-4bf8-8fe7-5ad614ee27a0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:51.491576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-02fda798-822a-4bf8-8fe7-5ad614ee27a0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:51.501080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-02fda798-822a-4bf8-8fe7-5ad614ee27a0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.262379 Dec 21 04:06:51.501687 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 255/514] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:51 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:51.536487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2d3cbe96-5245-4698-a86b-f3b3663095c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:51.537146 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2d3cbe96-5245-4698-a86b-f3b3663095c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:51.544911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d3cbe96-5245-4698-a86b-f3b3663095c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:51.545417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d3cbe96-5245-4698-a86b-f3b3663095c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:51.546242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d3cbe96-5245-4698-a86b-f3b3663095c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:51.546727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d3cbe96-5245-4698-a86b-f3b3663095c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:51.556873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e5a3ca73-1537-4c7b-a8cd-41d31c44de92 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:51.569139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e5a3ca73-1537-4c7b-a8cd-41d31c44de92 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1314 microversion: 2.1 time: 0.583287 Dec 21 04:06:51.569944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 260/515] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:50 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:51.590580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5af05dd1-2703-48b9-8ac7-e2ba45424cc2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:51.591288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5af05dd1-2703-48b9-8ac7-e2ba45424cc2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:51.600318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5af05dd1-2703-48b9-8ac7-e2ba45424cc2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:51.601040 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5af05dd1-2703-48b9-8ac7-e2ba45424cc2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:51.602059 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5af05dd1-2703-48b9-8ac7-e2ba45424cc2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:51.602701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5af05dd1-2703-48b9-8ac7-e2ba45424cc2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:51.796000 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2d3cbe96-5245-4698-a86b-f3b3663095c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:51.811792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2d3cbe96-5245-4698-a86b-f3b3663095c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:51.819241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2d3cbe96-5245-4698-a86b-f3b3663095c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:51.820471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2d3cbe96-5245-4698-a86b-f3b3663095c8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1722 microversion: 2.20 time: 0.293168 Dec 21 04:06:51.821289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 256/516] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:51 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:06:51.841058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4e3774c2-b309-4004-b439-c898024ba2c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:51.841723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4e3774c2-b309-4004-b439-c898024ba2c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:51.853107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e3774c2-b309-4004-b439-c898024ba2c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:51.853811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e3774c2-b309-4004-b439-c898024ba2c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:51.854441 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e3774c2-b309-4004-b439-c898024ba2c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:51.855137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e3774c2-b309-4004-b439-c898024ba2c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:52.098640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4e3774c2-b309-4004-b439-c898024ba2c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:52.100258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5af05dd1-2703-48b9-8ac7-e2ba45424cc2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:52.109720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5af05dd1-2703-48b9-8ac7-e2ba45424cc2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1515 microversion: 2.1 time: 0.528627 Dec 21 04:06:52.111065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 261/517] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:51 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1515 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:52.115262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4e3774c2-b309-4004-b439-c898024ba2c9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.283598 Dec 21 04:06:52.117226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 257/518] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:51 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:52.196772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-b30f75c6-c96c-4acd-be86-040ed0df1025 req-2eaef3ae-98df-4075-a5dc-bf6a098b9464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33f9dfc-75d8-4a80-b4e2-9947b3442aa5", "name": "network-vif-plugged", "status": "completed", "tag": "71d5bad2-6b96-4104-9da5-9c317eff8175"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:52.203599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:52.203599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:52.212826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-b30f75c6-c96c-4acd-be86-040ed0df1025 req-2eaef3ae-98df-4075-a5dc-bf6a098b9464 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:52.213487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-b30f75c6-c96c-4acd-be86-040ed0df1025 req-2eaef3ae-98df-4075-a5dc-bf6a098b9464 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:52.231865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-b30f75c6-c96c-4acd-be86-040ed0df1025 req-2eaef3ae-98df-4075-a5dc-bf6a098b9464 service nova] Creating event network-vif-plugged:71d5bad2-6b96-4104-9da5-9c317eff8175 for instance a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 on hv-cinder-73306 Dec 21 04:06:52.237115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-b30f75c6-c96c-4acd-be86-040ed0df1025 req-2eaef3ae-98df-4075-a5dc-bf6a098b9464 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050110 Dec 21 04:06:52.238885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 262/519] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:52 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:52.525665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-abed9280-acaf-4ad4-8ad9-00e8d52075ca tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:52.526606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-abed9280-acaf-4ad4-8ad9-00e8d52075ca tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:52.534438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abed9280-acaf-4ad4-8ad9-00e8d52075ca tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:52.535854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abed9280-acaf-4ad4-8ad9-00e8d52075ca tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:52.536701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abed9280-acaf-4ad4-8ad9-00e8d52075ca tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:52.537195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abed9280-acaf-4ad4-8ad9-00e8d52075ca tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:52.595466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-23a11c7e-ddab-4145-b83c-f7b4b65d71f7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:52.596947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-23a11c7e-ddab-4145-b83c-f7b4b65d71f7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:52.607949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23a11c7e-ddab-4145-b83c-f7b4b65d71f7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:52.608855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23a11c7e-ddab-4145-b83c-f7b4b65d71f7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:52.609878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23a11c7e-ddab-4145-b83c-f7b4b65d71f7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:52.610526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23a11c7e-ddab-4145-b83c-f7b4b65d71f7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:52.780710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-abed9280-acaf-4ad4-8ad9-00e8d52075ca tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:52.792470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-abed9280-acaf-4ad4-8ad9-00e8d52075ca tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.276744 Dec 21 04:06:52.793232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 258/520] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:52 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:52.846016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e65561f7-4e43-4082-9b75-2ed583ab944a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:52.846685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e65561f7-4e43-4082-9b75-2ed583ab944a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:52.855709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e65561f7-4e43-4082-9b75-2ed583ab944a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:52.856163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e65561f7-4e43-4082-9b75-2ed583ab944a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:52.856997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e65561f7-4e43-4082-9b75-2ed583ab944a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:52.857485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e65561f7-4e43-4082-9b75-2ed583ab944a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:53.007420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-23a11c7e-ddab-4145-b83c-f7b4b65d71f7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:53.016337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-23a11c7e-ddab-4145-b83c-f7b4b65d71f7 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1314 microversion: 2.1 time: 0.432010 Dec 21 04:06:53.016939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 263/521] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:52 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:53.076961 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e65561f7-4e43-4082-9b75-2ed583ab944a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:53.096680 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e65561f7-4e43-4082-9b75-2ed583ab944a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:53.104568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e65561f7-4e43-4082-9b75-2ed583ab944a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:53.105790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e65561f7-4e43-4082-9b75-2ed583ab944a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1722 microversion: 2.20 time: 0.269496 Dec 21 04:06:53.106389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 259/522] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:52 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:06:53.133883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-014bb994-7963-4ef6-a824-184a8c0bd5ce tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:53.134643 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-014bb994-7963-4ef6-a824-184a8c0bd5ce tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:53.137792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-93332ff6-8134-4659-8f4b-b9a71eb1868c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:53.138568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-93332ff6-8134-4659-8f4b-b9a71eb1868c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:53.142843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-014bb994-7963-4ef6-a824-184a8c0bd5ce tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:53.143472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-014bb994-7963-4ef6-a824-184a8c0bd5ce tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:53.144811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-014bb994-7963-4ef6-a824-184a8c0bd5ce tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:53.145351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-014bb994-7963-4ef6-a824-184a8c0bd5ce tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:53.147621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93332ff6-8134-4659-8f4b-b9a71eb1868c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:53.148136 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93332ff6-8134-4659-8f4b-b9a71eb1868c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:53.148977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93332ff6-8134-4659-8f4b-b9a71eb1868c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:53.149475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93332ff6-8134-4659-8f4b-b9a71eb1868c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:53.374530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-93332ff6-8134-4659-8f4b-b9a71eb1868c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:53.384624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-93332ff6-8134-4659-8f4b-b9a71eb1868c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.256317 Dec 21 04:06:53.385418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 260/523] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:53 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:06:53.424351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-014bb994-7963-4ef6-a824-184a8c0bd5ce tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:53.434073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-014bb994-7963-4ef6-a824-184a8c0bd5ce tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1515 microversion: 2.1 time: 0.309622 Dec 21 04:06:53.434773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 264/524] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:53 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1515 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:53.816992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-afa55564-3156-45a8-8a4b-4deccc14c2f7 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:53.817997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-afa55564-3156-45a8-8a4b-4deccc14c2f7 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:53.826155 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-afa55564-3156-45a8-8a4b-4deccc14c2f7 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:53.826745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-afa55564-3156-45a8-8a4b-4deccc14c2f7 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:53.827689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-afa55564-3156-45a8-8a4b-4deccc14c2f7 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:53.828258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-afa55564-3156-45a8-8a4b-4deccc14c2f7 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:53.904175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dec1868a-ad53-4024-bbda-6164405dd5de tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6665fd8-b55e-4ba2-afe2-fb67faeb33ed", "device": "/dev/sdb"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:53.905925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dec1868a-ad53-4024-bbda-6164405dd5de tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:53.914523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dec1868a-ad53-4024-bbda-6164405dd5de tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:53.915049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dec1868a-ad53-4024-bbda-6164405dd5de tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:53.915889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dec1868a-ad53-4024-bbda-6164405dd5de tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:53.916379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dec1868a-ad53-4024-bbda-6164405dd5de tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:54.060707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-afa55564-3156-45a8-8a4b-4deccc14c2f7 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:54.071999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-afa55564-3156-45a8-8a4b-4deccc14c2f7 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.264321 Dec 21 04:06:54.072840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 261/525] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:53 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:54.083517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8d209451-7b5d-4d6a-b590-da9ce4f90216 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:54.084198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8d209451-7b5d-4d6a-b590-da9ce4f90216 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:54.092878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d209451-7b5d-4d6a-b590-da9ce4f90216 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:54.093388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d209451-7b5d-4d6a-b590-da9ce4f90216 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:54.094314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d209451-7b5d-4d6a-b590-da9ce4f90216 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:54.094765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d209451-7b5d-4d6a-b590-da9ce4f90216 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:54.359436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8d209451-7b5d-4d6a-b590-da9ce4f90216 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:54.369027 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8d209451-7b5d-4d6a-b590-da9ce4f90216 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1314 microversion: 2.1 time: 0.295232 Dec 21 04:06:54.369910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 262/526] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:54 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:54.381349 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b9c0e8f3-0aad-4ca9-9cef-79f8454ca469 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:54.382033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b9c0e8f3-0aad-4ca9-9cef-79f8454ca469 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:54.390572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b9c0e8f3-0aad-4ca9-9cef-79f8454ca469 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:54.391058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b9c0e8f3-0aad-4ca9-9cef-79f8454ca469 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:54.391897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b9c0e8f3-0aad-4ca9-9cef-79f8454ca469 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:54.392634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b9c0e8f3-0aad-4ca9-9cef-79f8454ca469 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:54.478301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dec1868a-ad53-4024-bbda-6164405dd5de tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "POST /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.584286 Dec 21 04:06:54.479311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 265/527] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Dec 21 04:06:53 2020] POST /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4/os-volume_attachments => generated 194 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:54.497985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-f76bb06c-0ac7-4563-b4b2-37595d9cf6e0 req-52ba8c77-95f3-4731-a29b-561bee3b79fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c", "name": "network-vif-unplugged", "status": "completed", "tag": "90b6e1de-3fc7-4c40-b111-b929afe53945"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:54.505826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:54.505826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:54.518179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-f76bb06c-0ac7-4563-b4b2-37595d9cf6e0 req-52ba8c77-95f3-4731-a29b-561bee3b79fd service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:54.518710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-f76bb06c-0ac7-4563-b4b2-37595d9cf6e0 req-52ba8c77-95f3-4731-a29b-561bee3b79fd service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:54.537372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-f76bb06c-0ac7-4563-b4b2-37595d9cf6e0 req-52ba8c77-95f3-4731-a29b-561bee3b79fd service nova] Creating event network-vif-unplugged:90b6e1de-3fc7-4c40-b111-b929afe53945 for instance cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c on hv-cinder-73306 Dec 21 04:06:54.542501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-f76bb06c-0ac7-4563-b4b2-37595d9cf6e0 req-52ba8c77-95f3-4731-a29b-561bee3b79fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056093 Dec 21 04:06:54.543339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 266/528] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:54 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:54.554201 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-a77e4cc0-18d5-4b33-9ad1-753aa4433411 req-7e5cf87d-37df-4bba-85f2-d5f9c3f235e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c", "name": "network-vif-deleted", "tag": "90b6e1de-3fc7-4c40-b111-b929afe53945"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:54.561081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:54.561081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:54.571020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-a77e4cc0-18d5-4b33-9ad1-753aa4433411 req-7e5cf87d-37df-4bba-85f2-d5f9c3f235e1 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:54.571522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-a77e4cc0-18d5-4b33-9ad1-753aa4433411 req-7e5cf87d-37df-4bba-85f2-d5f9c3f235e1 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:54.589784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-a77e4cc0-18d5-4b33-9ad1-753aa4433411 req-7e5cf87d-37df-4bba-85f2-d5f9c3f235e1 service nova] Creating event network-vif-deleted:90b6e1de-3fc7-4c40-b111-b929afe53945 for instance cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c on hv-cinder-73306 Dec 21 04:06:54.595553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-a77e4cc0-18d5-4b33-9ad1-753aa4433411 req-7e5cf87d-37df-4bba-85f2-d5f9c3f235e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050986 Dec 21 04:06:54.596362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 267/529] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:54 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:06:54.613777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fab93655-42f3-4fd1-84fe-50dff5217cba tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:54.614588 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fab93655-42f3-4fd1-84fe-50dff5217cba tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:54.622826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fab93655-42f3-4fd1-84fe-50dff5217cba tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:54.623747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fab93655-42f3-4fd1-84fe-50dff5217cba tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:54.624194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fab93655-42f3-4fd1-84fe-50dff5217cba tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:54.624682 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fab93655-42f3-4fd1-84fe-50dff5217cba tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:54.643032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b9c0e8f3-0aad-4ca9-9cef-79f8454ca469 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:54.658389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b9c0e8f3-0aad-4ca9-9cef-79f8454ca469 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:54.666167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b9c0e8f3-0aad-4ca9-9cef-79f8454ca469 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:54.667427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b9c0e8f3-0aad-4ca9-9cef-79f8454ca469 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1722 microversion: 2.20 time: 0.296781 Dec 21 04:06:54.668203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 263/530] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:54 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:54.677757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c33528f1-456d-4b88-b1af-6e09198d273e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:54.678420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c33528f1-456d-4b88-b1af-6e09198d273e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:54.686199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c33528f1-456d-4b88-b1af-6e09198d273e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:54.686700 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c33528f1-456d-4b88-b1af-6e09198d273e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:54.687547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c33528f1-456d-4b88-b1af-6e09198d273e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:54.688033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c33528f1-456d-4b88-b1af-6e09198d273e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:54.772099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c33528f1-456d-4b88-b1af-6e09198d273e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:54.772767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c33528f1-456d-4b88-b1af-6e09198d273e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:54.773400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-c33528f1-456d-4b88-b1af-6e09198d273e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lazy-loading 'fault' on Instance uuid cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c {{(pid=94299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:06:54.841237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c33528f1-456d-4b88-b1af-6e09198d273e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:54.851194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c33528f1-456d-4b88-b1af-6e09198d273e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 200 len: 1308 microversion: 2.1 time: 0.182114 Dec 21 04:06:54.851792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 264/531] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:54 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:54.853893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fab93655-42f3-4fd1-84fe-50dff5217cba tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:54.863810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fab93655-42f3-4fd1-84fe-50dff5217cba tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.265548 Dec 21 04:06:54.864400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 268/532] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:54 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:55.095330 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-23a9141d-7e7e-4365-92e8-10688ec3c7a6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:55.095957 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-23a9141d-7e7e-4365-92e8-10688ec3c7a6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:55.104272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23a9141d-7e7e-4365-92e8-10688ec3c7a6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:55.104787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23a9141d-7e7e-4365-92e8-10688ec3c7a6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:55.105621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23a9141d-7e7e-4365-92e8-10688ec3c7a6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:55.106117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23a9141d-7e7e-4365-92e8-10688ec3c7a6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:55.335858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-23a9141d-7e7e-4365-92e8-10688ec3c7a6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:55.346546 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-23a9141d-7e7e-4365-92e8-10688ec3c7a6 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1568 microversion: 2.1 time: 0.260071 Dec 21 04:06:55.357491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 265/533] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:55 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:55.394414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-701dd730-2ad7-4024-b647-ff0ccaf43641 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:55.395293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-701dd730-2ad7-4024-b647-ff0ccaf43641 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:55.404250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-701dd730-2ad7-4024-b647-ff0ccaf43641 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:55.404448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-701dd730-2ad7-4024-b647-ff0ccaf43641 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:55.405277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-701dd730-2ad7-4024-b647-ff0ccaf43641 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:55.405768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-701dd730-2ad7-4024-b647-ff0ccaf43641 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:55.670859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-701dd730-2ad7-4024-b647-ff0ccaf43641 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:55.680731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-701dd730-2ad7-4024-b647-ff0ccaf43641 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1497 microversion: 2.1 time: 0.295270 Dec 21 04:06:55.690378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 269/534] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:55 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1497 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:55.696573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8788a813-a056-4906-b12b-69fa5c1ceeba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:55.697258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8788a813-a056-4906-b12b-69fa5c1ceeba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:55.706372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8788a813-a056-4906-b12b-69fa5c1ceeba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:55.707668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8788a813-a056-4906-b12b-69fa5c1ceeba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:55.708953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8788a813-a056-4906-b12b-69fa5c1ceeba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:55.709763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8788a813-a056-4906-b12b-69fa5c1ceeba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:55.875971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-76868fdb-5bd5-4183-b444-4d56af800918 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:55.883753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-76868fdb-5bd5-4183-b444-4d56af800918 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:55.892287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76868fdb-5bd5-4183-b444-4d56af800918 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:55.892801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76868fdb-5bd5-4183-b444-4d56af800918 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:55.893662 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76868fdb-5bd5-4183-b444-4d56af800918 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:55.894728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76868fdb-5bd5-4183-b444-4d56af800918 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:55.938787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8788a813-a056-4906-b12b-69fa5c1ceeba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:55.951080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-76868fdb-5bd5-4183-b444-4d56af800918 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] HTTP exception thrown: Instance cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c could not be found. Dec 21 04:06:55.952010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-76868fdb-5bd5-4183-b444-4d56af800918 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Returning 404 to user: Instance cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:06:55.953041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-76868fdb-5bd5-4183-b444-4d56af800918 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c" status: 404 len: 111 microversion: 2.1 time: 0.087373 Dec 21 04:06:55.957549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 270/535] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:55 2020] GET /compute/v2.1/servers/cc29fa6e-3042-4e2a-867c-e75b2c3d6f5c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 21 04:06:55.957815 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8788a813-a056-4906-b12b-69fa5c1ceeba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:55.962415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8788a813-a056-4906-b12b-69fa5c1ceeba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:55.963675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8788a813-a056-4906-b12b-69fa5c1ceeba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1722 microversion: 2.20 time: 0.280649 Dec 21 04:06:55.964249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 266/536] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:55 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:55.966720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a5f056b5-2e2a-42cf-a5b9-ab17ea9149ac tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:55.967508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a5f056b5-2e2a-42cf-a5b9-ab17ea9149ac tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:55.976166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5f056b5-2e2a-42cf-a5b9-ab17ea9149ac tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:55.976676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5f056b5-2e2a-42cf-a5b9-ab17ea9149ac tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:55.977521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5f056b5-2e2a-42cf-a5b9-ab17ea9149ac tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:55.978013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5f056b5-2e2a-42cf-a5b9-ab17ea9149ac tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:56.229151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a5f056b5-2e2a-42cf-a5b9-ab17ea9149ac tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:56.241888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a5f056b5-2e2a-42cf-a5b9-ab17ea9149ac tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.286547 Dec 21 04:06:56.242708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 271/537] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:55 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:56.372362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-87f987e9-d297-443f-85c0-c59f5cfd7137 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:56.376135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-87f987e9-d297-443f-85c0-c59f5cfd7137 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:56.396598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87f987e9-d297-443f-85c0-c59f5cfd7137 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:56.397298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87f987e9-d297-443f-85c0-c59f5cfd7137 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:56.398313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87f987e9-d297-443f-85c0-c59f5cfd7137 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:56.399468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87f987e9-d297-443f-85c0-c59f5cfd7137 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:56.846388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-87f987e9-d297-443f-85c0-c59f5cfd7137 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:56.857086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-87f987e9-d297-443f-85c0-c59f5cfd7137 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1548 microversion: 2.1 time: 0.495440 Dec 21 04:06:56.858011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 267/538] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:56 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1548 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:56.885181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6c382c53-3aaa-49c4-8396-199ea1702c4d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:56.886958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6c382c53-3aaa-49c4-8396-199ea1702c4d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:56.898735 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c382c53-3aaa-49c4-8396-199ea1702c4d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:56.899734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c382c53-3aaa-49c4-8396-199ea1702c4d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:56.900938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c382c53-3aaa-49c4-8396-199ea1702c4d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:56.901612 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c382c53-3aaa-49c4-8396-199ea1702c4d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:56.991351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2556b060-f0ca-46cd-b1af-152813da3b7a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:56.992001 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2556b060-f0ca-46cd-b1af-152813da3b7a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:57.002055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2556b060-f0ca-46cd-b1af-152813da3b7a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.002805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2556b060-f0ca-46cd-b1af-152813da3b7a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.003927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2556b060-f0ca-46cd-b1af-152813da3b7a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.004606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2556b060-f0ca-46cd-b1af-152813da3b7a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.100659 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-6c382c53-3aaa-49c4-8396-199ea1702c4d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] HTTP exception thrown: Cannot 'detach_volume' instance 066ef53e-6421-4004-bd12-2e238a638cd1 while it is in vm_state rescued Dec 21 04:06:57.101340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6c382c53-3aaa-49c4-8396-199ea1702c4d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Returning 409 to user: Cannot 'detach_volume' instance 066ef53e-6421-4004-bd12-2e238a638cd1 while it is in vm_state rescued {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:06:57.102391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6c382c53-3aaa-49c4-8396-199ea1702c4d tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "DELETE /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/os-volume_attachments/5f1f2b1e-c4b0-41a7-93b7-3aca1dd950ea" status: 409 len: 152 microversion: 2.1 time: 0.230313 Dec 21 04:06:57.106418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 272/539] 10.222.0.16 () {58 vars in 1406 bytes} [Mon Dec 21 04:06:56 2020] DELETE /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/os-volume_attachments/5f1f2b1e-c4b0-41a7-93b7-3aca1dd950ea => generated 152 bytes in 232 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 21 04:06:57.114214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a58bdbe3-cdce-4077-8154-bc1eed387c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:57.114770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a58bdbe3-cdce-4077-8154-bc1eed387c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:57.123267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a58bdbe3-cdce-4077-8154-bc1eed387c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.124078 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a58bdbe3-cdce-4077-8154-bc1eed387c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.124610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a58bdbe3-cdce-4077-8154-bc1eed387c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.125107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a58bdbe3-cdce-4077-8154-bc1eed387c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.199801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a58bdbe3-cdce-4077-8154-bc1eed387c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Going to try to terminate instance {{(pid=94298) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:06:57.239176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2556b060-f0ca-46cd-b1af-152813da3b7a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:57.255201 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2556b060-f0ca-46cd-b1af-152813da3b7a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:57.261898 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2556b060-f0ca-46cd-b1af-152813da3b7a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:57.263154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2556b060-f0ca-46cd-b1af-152813da3b7a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1665 microversion: 2.20 time: 0.283301 Dec 21 04:06:57.263913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 268/540] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:56 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1665 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:06:57.274038 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-88db5bd1-8890-4009-94b3-cabff537f601 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:57.274634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-88db5bd1-8890-4009-94b3-cabff537f601 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:57.283597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88db5bd1-8890-4009-94b3-cabff537f601 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.284110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88db5bd1-8890-4009-94b3-cabff537f601 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.285780 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88db5bd1-8890-4009-94b3-cabff537f601 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.286429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88db5bd1-8890-4009-94b3-cabff537f601 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.322283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a58bdbe3-cdce-4077-8154-bc1eed387c47 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "DELETE /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 204 len: 0 microversion: 2.1 time: 0.217444 Dec 21 04:06:57.326108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 273/541] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:06:57 2020] DELETE /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:06:57.335314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-2e74887b-fd11-4cbc-8ccc-65ef3860995a req-34fb04fe-98b1-4d29-8250-b01fa4b0815b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37226a3f-240e-4e04-9813-fa3d109452de", "name": "network-vif-unplugged", "status": "completed", "tag": "cebf23f8-0aba-463b-89c6-d9e38a717d77"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:57.342175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:57.342175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:06:57.351844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-2e74887b-fd11-4cbc-8ccc-65ef3860995a req-34fb04fe-98b1-4d29-8250-b01fa4b0815b service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.352347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-2e74887b-fd11-4cbc-8ccc-65ef3860995a req-34fb04fe-98b1-4d29-8250-b01fa4b0815b service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.369598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.compute.server_external_events [req-2e74887b-fd11-4cbc-8ccc-65ef3860995a req-34fb04fe-98b1-4d29-8250-b01fa4b0815b service nova] Unable to find a host for instance 37226a3f-240e-4e04-9813-fa3d109452de. Dropping event network-vif-unplugged {{(pid=94298) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Dec 21 04:06:57.370541 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-2e74887b-fd11-4cbc-8ccc-65ef3860995a req-34fb04fe-98b1-4d29-8250-b01fa4b0815b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.046180 Dec 21 04:06:57.371225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 274/542] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:06:57 2020] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 21 04:06:57.381414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6a8228ee-4e34-430d-acd6-8af5f9761552 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:57.382193 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6a8228ee-4e34-430d-acd6-8af5f9761552 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:57.389763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6a8228ee-4e34-430d-acd6-8af5f9761552 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.390270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6a8228ee-4e34-430d-acd6-8af5f9761552 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.391128 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6a8228ee-4e34-430d-acd6-8af5f9761552 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.391619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6a8228ee-4e34-430d-acd6-8af5f9761552 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.444320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-88db5bd1-8890-4009-94b3-cabff537f601 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "POST /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/action" status: 202 len: 0 microversion: 2.1 time: 0.179154 Dec 21 04:06:57.455637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 269/543] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:06:57 2020] POST /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:06:57.470661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-45ec130d-d646-484c-9fd1-c587f54b8978 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00439084-dd55-410e-9b02-c86f7781532b"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:57.476041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-45ec130d-d646-484c-9fd1-c587f54b8978 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:57.486679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-45ec130d-d646-484c-9fd1-c587f54b8978 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.487393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-45ec130d-d646-484c-9fd1-c587f54b8978 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.488658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-45ec130d-d646-484c-9fd1-c587f54b8978 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.489379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-45ec130d-d646-484c-9fd1-c587f54b8978 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.801778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6a8228ee-4e34-430d-acd6-8af5f9761552 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:57.812791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6a8228ee-4e34-430d-acd6-8af5f9761552 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.440435 Dec 21 04:06:57.813626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 275/544] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:57 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:57.838181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4af94fde-a6da-4ec7-b9a4-1adcf72747fd tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:57.839080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4af94fde-a6da-4ec7-b9a4-1adcf72747fd tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:57.847952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4af94fde-a6da-4ec7-b9a4-1adcf72747fd tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.848616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4af94fde-a6da-4ec7-b9a4-1adcf72747fd tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.849462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4af94fde-a6da-4ec7-b9a4-1adcf72747fd tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:57.849956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4af94fde-a6da-4ec7-b9a4-1adcf72747fd tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:57.992168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-45ec130d-d646-484c-9fd1-c587f54b8978 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.531240 Dec 21 04:06:57.992949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 270/545] 10.222.0.16 () {62 vars in 1354 bytes} [Mon Dec 21 04:06:57 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/os-volume_attachments => generated 188 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:06:58.004728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ee18bc90-eb91-45b6-9241-eff85e99cf6f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:58.005606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ee18bc90-eb91-45b6-9241-eff85e99cf6f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:58.013652 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee18bc90-eb91-45b6-9241-eff85e99cf6f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:58.014438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee18bc90-eb91-45b6-9241-eff85e99cf6f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:58.015526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee18bc90-eb91-45b6-9241-eff85e99cf6f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:58.016207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee18bc90-eb91-45b6-9241-eff85e99cf6f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:58.264883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ee18bc90-eb91-45b6-9241-eff85e99cf6f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:58.275345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ee18bc90-eb91-45b6-9241-eff85e99cf6f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1556 microversion: 2.1 time: 0.281011 Dec 21 04:06:58.275971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 271/546] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:57 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1556 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:58.286242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-768c8ac8-ccb9-414b-9e50-af250e474194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:58.286800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-768c8ac8-ccb9-414b-9e50-af250e474194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:58.295010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-768c8ac8-ccb9-414b-9e50-af250e474194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:58.295519 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-768c8ac8-ccb9-414b-9e50-af250e474194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:58.296376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-768c8ac8-ccb9-414b-9e50-af250e474194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:58.296874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-768c8ac8-ccb9-414b-9e50-af250e474194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:58.372804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-768c8ac8-ccb9-414b-9e50-af250e474194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Going to try to terminate instance {{(pid=94299) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:06:58.503996 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4af94fde-a6da-4ec7-b9a4-1adcf72747fd tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:58.505222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-768c8ac8-ccb9-414b-9e50-af250e474194 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "DELETE /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 204 len: 0 microversion: 2.1 time: 0.227758 Dec 21 04:06:58.509668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 272/547] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:06:58 2020] DELETE /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:06:58.514977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4af94fde-a6da-4ec7-b9a4-1adcf72747fd tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1503 microversion: 2.1 time: 0.690264 Dec 21 04:06:58.525394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 276/548] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:57 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1503 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:58.525593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dac9c371-672b-4203-a5bf-466889b92cad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:06:58.525593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dac9c371-672b-4203-a5bf-466889b92cad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:58.527143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-31d48d2a-68a3-45b3-b015-923c2b15813b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:58.527819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-31d48d2a-68a3-45b3-b015-923c2b15813b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:58.529454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dac9c371-672b-4203-a5bf-466889b92cad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:58.530034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dac9c371-672b-4203-a5bf-466889b92cad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:58.530956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dac9c371-672b-4203-a5bf-466889b92cad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:58.531537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dac9c371-672b-4203-a5bf-466889b92cad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:58.536388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31d48d2a-68a3-45b3-b015-923c2b15813b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:58.536900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31d48d2a-68a3-45b3-b015-923c2b15813b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:58.537802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31d48d2a-68a3-45b3-b015-923c2b15813b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:58.538388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31d48d2a-68a3-45b3-b015-923c2b15813b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:58.692876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dac9c371-672b-4203-a5bf-466889b92cad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action" status: 202 len: 0 microversion: 2.20 time: 0.184757 Dec 21 04:06:58.693625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 273/549] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:06:58 2020] POST /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:06:58.707207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-315d89ce-da75-4ee5-98fd-0a68c2bcf1de tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:58.708028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-315d89ce-da75-4ee5-98fd-0a68c2bcf1de tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:58.716319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-315d89ce-da75-4ee5-98fd-0a68c2bcf1de tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:58.716880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-315d89ce-da75-4ee5-98fd-0a68c2bcf1de tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:58.717786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-315d89ce-da75-4ee5-98fd-0a68c2bcf1de tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:58.718416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-315d89ce-da75-4ee5-98fd-0a68c2bcf1de tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:58.855145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-31d48d2a-68a3-45b3-b015-923c2b15813b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:58.864995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-31d48d2a-68a3-45b3-b015-923c2b15813b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1513 microversion: 2.1 time: 0.348237 Dec 21 04:06:58.865606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 277/550] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:58 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1513 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:58.876367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4d52d37d-1450-4f53-bb1f-1923075b27e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:58.877195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4d52d37d-1450-4f53-bb1f-1923075b27e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:58.885319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d52d37d-1450-4f53-bb1f-1923075b27e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:58.886077 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d52d37d-1450-4f53-bb1f-1923075b27e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:58.887029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d52d37d-1450-4f53-bb1f-1923075b27e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:58.887675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d52d37d-1450-4f53-bb1f-1923075b27e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:58.950483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-315d89ce-da75-4ee5-98fd-0a68c2bcf1de tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:58.967673 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-315d89ce-da75-4ee5-98fd-0a68c2bcf1de tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:58.974766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-315d89ce-da75-4ee5-98fd-0a68c2bcf1de tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:58.976047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-315d89ce-da75-4ee5-98fd-0a68c2bcf1de tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1751 microversion: 2.20 time: 0.278264 Dec 21 04:06:58.982978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 274/551] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:58 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1751 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:06:59.134029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4d52d37d-1450-4f53-bb1f-1923075b27e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:59.144891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4d52d37d-1450-4f53-bb1f-1923075b27e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1726 microversion: 2.1 time: 0.278165 Dec 21 04:06:59.145693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 278/552] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:58 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1726 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:59.299422 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4d17e9e2-f706-4487-8c20-912026648108 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:59.300730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4d17e9e2-f706-4487-8c20-912026648108 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:59.309937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d17e9e2-f706-4487-8c20-912026648108 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:59.310519 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d17e9e2-f706-4487-8c20-912026648108 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:59.311661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d17e9e2-f706-4487-8c20-912026648108 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:59.312157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d17e9e2-f706-4487-8c20-912026648108 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:59.539673 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6626cd46-b4a4-40af-b250-f9265fccf95a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:59.540349 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6626cd46-b4a4-40af-b250-f9265fccf95a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:59.544710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4d17e9e2-f706-4487-8c20-912026648108 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:59.548372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6626cd46-b4a4-40af-b250-f9265fccf95a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:59.548954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6626cd46-b4a4-40af-b250-f9265fccf95a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:59.549894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6626cd46-b4a4-40af-b250-f9265fccf95a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:59.551103 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6626cd46-b4a4-40af-b250-f9265fccf95a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:59.555772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4d17e9e2-f706-4487-8c20-912026648108 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1556 microversion: 2.1 time: 0.265902 Dec 21 04:06:59.556587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 275/553] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:59 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1556 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:06:59.888543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-89f69b90-3346-4596-84a2-ad6850f6ecef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:06:59.889211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-89f69b90-3346-4596-84a2-ad6850f6ecef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:06:59.897551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-89f69b90-3346-4596-84a2-ad6850f6ecef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:59.898053 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-89f69b90-3346-4596-84a2-ad6850f6ecef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:59.898881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-89f69b90-3346-4596-84a2-ad6850f6ecef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:06:59.899392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-89f69b90-3346-4596-84a2-ad6850f6ecef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:06:59.951645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6626cd46-b4a4-40af-b250-f9265fccf95a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:06:59.964109 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6626cd46-b4a4-40af-b250-f9265fccf95a tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1503 microversion: 2.1 time: 0.434433 Dec 21 04:06:59.972854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 279/554] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:59 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:00.002425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0e0c9c99-ce30-4d17-a877-4763f796b041 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:00.003492 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0e0c9c99-ce30-4d17-a877-4763f796b041 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:00.012335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c99-ce30-4d17-a877-4763f796b041 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:00.012831 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c99-ce30-4d17-a877-4763f796b041 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:00.013669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c99-ce30-4d17-a877-4763f796b041 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:00.014204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0e0c9c99-ce30-4d17-a877-4763f796b041 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:00.143442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-89f69b90-3346-4596-84a2-ad6850f6ecef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:00.152491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-89f69b90-3346-4596-84a2-ad6850f6ecef tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1513 microversion: 2.1 time: 0.273220 Dec 21 04:07:00.153089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 276/555] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:06:59 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:00.168749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6c197323-5f5e-41f0-9f8d-ff156075f989 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:00.169446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6c197323-5f5e-41f0-9f8d-ff156075f989 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:00.178554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c197323-5f5e-41f0-9f8d-ff156075f989 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:00.179096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c197323-5f5e-41f0-9f8d-ff156075f989 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:00.179947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c197323-5f5e-41f0-9f8d-ff156075f989 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:00.180443 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c197323-5f5e-41f0-9f8d-ff156075f989 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:00.424143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0e0c9c99-ce30-4d17-a877-4763f796b041 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:00.462026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6c197323-5f5e-41f0-9f8d-ff156075f989 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:00.467730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0e0c9c99-ce30-4d17-a877-4763f796b041 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:00.474544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6c197323-5f5e-41f0-9f8d-ff156075f989 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1703 microversion: 2.1 time: 0.315038 Dec 21 04:07:00.486925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0e0c9c99-ce30-4d17-a877-4763f796b041 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:00.486925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0e0c9c99-ce30-4d17-a877-4763f796b041 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1753 microversion: 2.20 time: 0.489671 Dec 21 04:07:00.486925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 280/556] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:06:59 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1753 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:07:00.489262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 277/557] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:00 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1703 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:00.515889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f908fdd3-57ea-4bea-92f3-81d513774002 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:00.538738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f908fdd3-57ea-4bea-92f3-81d513774002 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:00.539275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f908fdd3-57ea-4bea-92f3-81d513774002 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:00.579445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f0713591-a894-4f46-9fc1-4010eed62a22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:00.580303 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f0713591-a894-4f46-9fc1-4010eed62a22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:00.589055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0713591-a894-4f46-9fc1-4010eed62a22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:00.589686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0713591-a894-4f46-9fc1-4010eed62a22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:00.590883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0713591-a894-4f46-9fc1-4010eed62a22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:00.592105 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0713591-a894-4f46-9fc1-4010eed62a22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:00.611729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f908fdd3-57ea-4bea-92f3-81d513774002 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Going to try to start instance {{(pid=94298) start /opt/stack/nova/nova/compute/api.py:2599}} Dec 21 04:07:00.696911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f908fdd3-57ea-4bea-92f3-81d513774002 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 202 len: 0 microversion: 2.1 time: 0.193253 Dec 21 04:07:00.697870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 281/558] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:07:00 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:07:00.711301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-ab6246d9-5991-4684-be75-aac3a1552c91 req-edd7d941-5ffb-4598-9dc6-a192b9b1fd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33f9dfc-75d8-4a80-b4e2-9947b3442aa5", "name": "network-vif-deleted", "tag": "71d5bad2-6b96-4104-9da5-9c317eff8175"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:00.718360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:00.718360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:07:00.729106 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-ab6246d9-5991-4684-be75-aac3a1552c91 req-edd7d941-5ffb-4598-9dc6-a192b9b1fd6a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:00.729790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-ab6246d9-5991-4684-be75-aac3a1552c91 req-edd7d941-5ffb-4598-9dc6-a192b9b1fd6a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:00.751551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-ab6246d9-5991-4684-be75-aac3a1552c91 req-edd7d941-5ffb-4598-9dc6-a192b9b1fd6a service nova] Creating event network-vif-deleted:71d5bad2-6b96-4104-9da5-9c317eff8175 for instance a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 on hv-cinder-73306 Dec 21 04:07:00.756544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-ab6246d9-5991-4684-be75-aac3a1552c91 req-edd7d941-5ffb-4598-9dc6-a192b9b1fd6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056967 Dec 21 04:07:00.757341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 282/559] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:07:00 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:07:00.770576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8a533498-72a5-4451-8310-c30a6e13223b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:00.770789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8a533498-72a5-4451-8310-c30a6e13223b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:00.781750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8a533498-72a5-4451-8310-c30a6e13223b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:00.782280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8a533498-72a5-4451-8310-c30a6e13223b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:00.783755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8a533498-72a5-4451-8310-c30a6e13223b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:00.784258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8a533498-72a5-4451-8310-c30a6e13223b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:00.912931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f0713591-a894-4f46-9fc1-4010eed62a22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:00.923598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f0713591-a894-4f46-9fc1-4010eed62a22 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1556 microversion: 2.1 time: 0.353616 Dec 21 04:07:00.935831 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 278/560] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:00 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1556 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:00.989468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-777c2a9e-6170-438d-8224-cd2949279c33 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:00.990151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-777c2a9e-6170-438d-8224-cd2949279c33 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:00.998665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-777c2a9e-6170-438d-8224-cd2949279c33 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:00.999224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-777c2a9e-6170-438d-8224-cd2949279c33 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:01.000087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-777c2a9e-6170-438d-8224-cd2949279c33 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:01.000584 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-777c2a9e-6170-438d-8224-cd2949279c33 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:01.087832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-777c2a9e-6170-438d-8224-cd2949279c33 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:01.088296 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-777c2a9e-6170-438d-8224-cd2949279c33 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:01.088829 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-777c2a9e-6170-438d-8224-cd2949279c33 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lazy-loading 'fault' on Instance uuid a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 {{(pid=94299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:07:01.134934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8a533498-72a5-4451-8310-c30a6e13223b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:01.147880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8a533498-72a5-4451-8310-c30a6e13223b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1712 microversion: 2.1 time: 0.389413 Dec 21 04:07:01.149497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 283/561] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:00 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1712 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:01.161618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-777c2a9e-6170-438d-8224-cd2949279c33 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6a4d0576b74b53a97b6513edaa6ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f21126d7d455391ef888198a0925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:01.175131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-777c2a9e-6170-438d-8224-cd2949279c33 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 200 len: 1304 microversion: 2.1 time: 0.195787 Dec 21 04:07:01.175851 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b8d4acfd-c7fc-45d3-bc42-8a7cc129f8d3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:01.176714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b8d4acfd-c7fc-45d3-bc42-8a7cc129f8d3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:01.178937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 279/562] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:00 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 1304 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:01.196339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b8d4acfd-c7fc-45d3-bc42-8a7cc129f8d3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:01.196847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b8d4acfd-c7fc-45d3-bc42-8a7cc129f8d3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:01.197688 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b8d4acfd-c7fc-45d3-bc42-8a7cc129f8d3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:01.198174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b8d4acfd-c7fc-45d3-bc42-8a7cc129f8d3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:01.509220 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3d9b208b-564f-4163-9795-7f9389d60b8e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:01.509889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3d9b208b-564f-4163-9795-7f9389d60b8e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:01.518028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d9b208b-564f-4163-9795-7f9389d60b8e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:01.518528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d9b208b-564f-4163-9795-7f9389d60b8e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:01.519914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d9b208b-564f-4163-9795-7f9389d60b8e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:01.520426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d9b208b-564f-4163-9795-7f9389d60b8e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:01.758464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3d9b208b-564f-4163-9795-7f9389d60b8e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:01.774775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3d9b208b-564f-4163-9795-7f9389d60b8e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:01.781428 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3d9b208b-564f-4163-9795-7f9389d60b8e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:01.782639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3d9b208b-564f-4163-9795-7f9389d60b8e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1753 microversion: 2.20 time: 0.283175 Dec 21 04:07:01.783469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 280/563] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:01 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1753 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:07:01.952119 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e4da94c1-1872-4321-9b7d-283597adf159 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:01.953436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e4da94c1-1872-4321-9b7d-283597adf159 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:01.957102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b8d4acfd-c7fc-45d3-bc42-8a7cc129f8d3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:01.964935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4da94c1-1872-4321-9b7d-283597adf159 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:01.965529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4da94c1-1872-4321-9b7d-283597adf159 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:01.966494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4da94c1-1872-4321-9b7d-283597adf159 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:01.967137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4da94c1-1872-4321-9b7d-283597adf159 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:01.977761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b8d4acfd-c7fc-45d3-bc42-8a7cc129f8d3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1513 microversion: 2.1 time: 0.811875 Dec 21 04:07:01.991255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 284/564] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:01 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1513 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:02.176045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f61ce9fa-aa45-4458-a92c-62aaa457977a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:02.177447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f61ce9fa-aa45-4458-a92c-62aaa457977a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:02.187745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f61ce9fa-aa45-4458-a92c-62aaa457977a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:02.188684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f61ce9fa-aa45-4458-a92c-62aaa457977a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:02.193354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f61ce9fa-aa45-4458-a92c-62aaa457977a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:02.194498 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f61ce9fa-aa45-4458-a92c-62aaa457977a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:02.400791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e4da94c1-1872-4321-9b7d-283597adf159 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:02.411275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e4da94c1-1872-4321-9b7d-283597adf159 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1562 microversion: 2.1 time: 0.470867 Dec 21 04:07:02.423763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 281/565] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:01 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1562 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:02.423763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-71eecc31-91d3-482d-bcdf-732175967344 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:02.423763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-71eecc31-91d3-482d-bcdf-732175967344 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] [instance: a33f9dfc-75d8-4a80-b4e2-9947b3442aa5] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:02.434073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-71eecc31-91d3-482d-bcdf-732175967344 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:02.434715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-71eecc31-91d3-482d-bcdf-732175967344 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:02.435738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-71eecc31-91d3-482d-bcdf-732175967344 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:02.436342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-71eecc31-91d3-482d-bcdf-732175967344 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:02.571698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-71eecc31-91d3-482d-bcdf-732175967344 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] HTTP exception thrown: Instance a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 could not be found. Dec 21 04:07:02.572379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-71eecc31-91d3-482d-bcdf-732175967344 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] Returning 404 to user: Instance a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:07:02.573284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-71eecc31-91d3-482d-bcdf-732175967344 tempest-VolumesActionsTest-991285254 tempest-VolumesActionsTest-991285254] 10.222.0.16 "GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5" status: 404 len: 111 microversion: 2.1 time: 0.160135 Dec 21 04:07:02.574280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 282/566] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:02 2020] GET /compute/v2.1/servers/a33f9dfc-75d8-4a80-b4e2-9947b3442aa5 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:07:02.597863 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dcceb23e-b625-4a2c-942d-f6b5e750b0ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:02.598561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dcceb23e-b625-4a2c-942d-f6b5e750b0ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:02.607704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dcceb23e-b625-4a2c-942d-f6b5e750b0ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:02.608212 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dcceb23e-b625-4a2c-942d-f6b5e750b0ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:02.609061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dcceb23e-b625-4a2c-942d-f6b5e750b0ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:02.609764 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dcceb23e-b625-4a2c-942d-f6b5e750b0ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:03.005392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f61ce9fa-aa45-4458-a92c-62aaa457977a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:03.044509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f61ce9fa-aa45-4458-a92c-62aaa457977a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1712 microversion: 2.1 time: 0.880375 Dec 21 04:07:03.045822 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 285/567] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:02 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1712 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:03.068002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bea42bed-2125-4153-9e7d-259f7134efb3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:03.068993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bea42bed-2125-4153-9e7d-259f7134efb3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:03.084370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bea42bed-2125-4153-9e7d-259f7134efb3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:03.086109 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bea42bed-2125-4153-9e7d-259f7134efb3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:03.092192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bea42bed-2125-4153-9e7d-259f7134efb3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:03.092896 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bea42bed-2125-4153-9e7d-259f7134efb3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:03.261861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dcceb23e-b625-4a2c-942d-f6b5e750b0ac tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "DELETE /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/os-volume_attachments/5f1f2b1e-c4b0-41a7-93b7-3aca1dd950ea" status: 202 len: 0 microversion: 2.1 time: 0.681886 Dec 21 04:07:03.262510 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 283/568] 10.222.0.16 () {58 vars in 1406 bytes} [Mon Dec 21 04:07:02 2020] DELETE /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1/os-volume_attachments/5f1f2b1e-c4b0-41a7-93b7-3aca1dd950ea => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:07:03.288794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a8fc9347-032f-45f3-8d26-2f74c44d70f5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:03.291582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a8fc9347-032f-45f3-8d26-2f74c44d70f5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:03.301811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8fc9347-032f-45f3-8d26-2f74c44d70f5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:03.302317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8fc9347-032f-45f3-8d26-2f74c44d70f5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:03.303202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8fc9347-032f-45f3-8d26-2f74c44d70f5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:03.303697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8fc9347-032f-45f3-8d26-2f74c44d70f5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:03.516523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a8fc9347-032f-45f3-8d26-2f74c44d70f5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:03.539930 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a8fc9347-032f-45f3-8d26-2f74c44d70f5 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1471 microversion: 2.1 time: 0.272102 Dec 21 04:07:03.550710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 284/569] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:03 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1471 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:03.787771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-db352f5d-fcca-46a2-9267-4b615cf2ebd6 req-6f10ee1a-0d1e-4b99-b3f7-4c110b120264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b779469-1f62-473f-adda-86fc33a0e8df", "name": "network-vif-deleted", "tag": "6717ed8d-7c1e-4b4b-a666-05029d5a07ef"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:03.810930 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:03.810930 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:07:03.820492 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-db352f5d-fcca-46a2-9267-4b615cf2ebd6 req-6f10ee1a-0d1e-4b99-b3f7-4c110b120264 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:03.829171 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-db352f5d-fcca-46a2-9267-4b615cf2ebd6 req-6f10ee1a-0d1e-4b99-b3f7-4c110b120264 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:03.853375 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-db352f5d-fcca-46a2-9267-4b615cf2ebd6 req-6f10ee1a-0d1e-4b99-b3f7-4c110b120264 service nova] Creating event network-vif-deleted:6717ed8d-7c1e-4b4b-a666-05029d5a07ef for instance 5b779469-1f62-473f-adda-86fc33a0e8df on hv-cinder-73306 Dec 21 04:07:03.858971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-db352f5d-fcca-46a2-9267-4b615cf2ebd6 req-6f10ee1a-0d1e-4b99-b3f7-4c110b120264 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080559 Dec 21 04:07:03.859857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 285/570] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:07:03 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:07:03.912149 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bea42bed-2125-4153-9e7d-259f7134efb3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:03.927739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bea42bed-2125-4153-9e7d-259f7134efb3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:03.934154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bea42bed-2125-4153-9e7d-259f7134efb3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:03.935392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bea42bed-2125-4153-9e7d-259f7134efb3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1753 microversion: 2.20 time: 0.887861 Dec 21 04:07:03.935993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 286/571] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:03 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1753 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:04.069248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-90a630ea-0940-49a4-8022-e63fbb0e0fd0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:04.070016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-90a630ea-0940-49a4-8022-e63fbb0e0fd0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:04.078028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90a630ea-0940-49a4-8022-e63fbb0e0fd0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:04.078515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90a630ea-0940-49a4-8022-e63fbb0e0fd0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:04.083521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90a630ea-0940-49a4-8022-e63fbb0e0fd0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:04.084004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90a630ea-0940-49a4-8022-e63fbb0e0fd0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:04.399918 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-90a630ea-0940-49a4-8022-e63fbb0e0fd0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:04.421331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-90a630ea-0940-49a4-8022-e63fbb0e0fd0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1712 microversion: 2.1 time: 0.362141 Dec 21 04:07:04.422190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 286/572] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:04 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1712 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:04.563479 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7bd53f27-bb8f-4b16-8e56-b9bb3f26a591 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:04.564489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7bd53f27-bb8f-4b16-8e56-b9bb3f26a591 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:04.574809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7bd53f27-bb8f-4b16-8e56-b9bb3f26a591 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:04.575437 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7bd53f27-bb8f-4b16-8e56-b9bb3f26a591 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:04.576497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7bd53f27-bb8f-4b16-8e56-b9bb3f26a591 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:04.577201 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7bd53f27-bb8f-4b16-8e56-b9bb3f26a591 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:04.742451 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7bd53f27-bb8f-4b16-8e56-b9bb3f26a591 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:04.751445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7bd53f27-bb8f-4b16-8e56-b9bb3f26a591 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1302 microversion: 2.1 time: 0.197366 Dec 21 04:07:04.752078 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 287/573] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:04 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1302 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:04.960612 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-aeb9607f-7013-4fb8-b3a3-8acdad67c780 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:04.961262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-aeb9607f-7013-4fb8-b3a3-8acdad67c780 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:04.969344 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aeb9607f-7013-4fb8-b3a3-8acdad67c780 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:04.969852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aeb9607f-7013-4fb8-b3a3-8acdad67c780 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:04.970685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aeb9607f-7013-4fb8-b3a3-8acdad67c780 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:04.971207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aeb9607f-7013-4fb8-b3a3-8acdad67c780 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:05.189174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-aeb9607f-7013-4fb8-b3a3-8acdad67c780 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:05.204102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-aeb9607f-7013-4fb8-b3a3-8acdad67c780 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:05.211692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-aeb9607f-7013-4fb8-b3a3-8acdad67c780 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:05.212899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-aeb9607f-7013-4fb8-b3a3-8acdad67c780 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1753 microversion: 2.20 time: 0.261616 Dec 21 04:07:05.213672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 287/574] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:04 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1753 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:05.446275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6e14e0d0-602d-49e4-955a-69ed210d0638 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:05.447285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6e14e0d0-602d-49e4-955a-69ed210d0638 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:05.455746 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6e14e0d0-602d-49e4-955a-69ed210d0638 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:05.457288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6e14e0d0-602d-49e4-955a-69ed210d0638 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:05.458530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6e14e0d0-602d-49e4-955a-69ed210d0638 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:05.459256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6e14e0d0-602d-49e4-955a-69ed210d0638 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:05.730629 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6e14e0d0-602d-49e4-955a-69ed210d0638 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:05.741659 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6e14e0d0-602d-49e4-955a-69ed210d0638 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1712 microversion: 2.1 time: 0.305676 Dec 21 04:07:05.742824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 288/575] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:05 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1712 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:05.774463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-552aa98c-2dc3-475c-a0f0-0cb609b44b3c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:05.775275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-552aa98c-2dc3-475c-a0f0-0cb609b44b3c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:05.783567 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-552aa98c-2dc3-475c-a0f0-0cb609b44b3c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:05.784157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-552aa98c-2dc3-475c-a0f0-0cb609b44b3c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:05.785666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-552aa98c-2dc3-475c-a0f0-0cb609b44b3c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:05.786237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-552aa98c-2dc3-475c-a0f0-0cb609b44b3c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:05.949784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-552aa98c-2dc3-475c-a0f0-0cb609b44b3c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:05.959295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-552aa98c-2dc3-475c-a0f0-0cb609b44b3c tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1302 microversion: 2.1 time: 0.194307 Dec 21 04:07:05.959884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 288/576] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:05 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1302 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:06.252370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a5ef8cdd-7b58-4fa3-b377-6aa4fa9a2011 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:06.255844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a5ef8cdd-7b58-4fa3-b377-6aa4fa9a2011 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:06.267753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5ef8cdd-7b58-4fa3-b377-6aa4fa9a2011 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:06.268528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5ef8cdd-7b58-4fa3-b377-6aa4fa9a2011 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:06.269638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5ef8cdd-7b58-4fa3-b377-6aa4fa9a2011 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:06.270326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5ef8cdd-7b58-4fa3-b377-6aa4fa9a2011 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:06.728110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a5ef8cdd-7b58-4fa3-b377-6aa4fa9a2011 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:06.747420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a5ef8cdd-7b58-4fa3-b377-6aa4fa9a2011 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:06.762798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a5ef8cdd-7b58-4fa3-b377-6aa4fa9a2011 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:06.764373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a5ef8cdd-7b58-4fa3-b377-6aa4fa9a2011 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1753 microversion: 2.20 time: 0.535265 Dec 21 04:07:06.770961 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4ee5e6ad-608d-4df1-b4b1-fb8de979bd4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:06.770961 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4ee5e6ad-608d-4df1-b4b1-fb8de979bd4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:06.771975 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 289/577] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:06 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1753 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:06.778628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4ee5e6ad-608d-4df1-b4b1-fb8de979bd4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:06.779178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4ee5e6ad-608d-4df1-b4b1-fb8de979bd4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:06.780003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4ee5e6ad-608d-4df1-b4b1-fb8de979bd4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:06.780790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4ee5e6ad-608d-4df1-b4b1-fb8de979bd4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:06.983455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c35dc531-b39e-4fac-ba5b-f6d5fee1fef1 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:06.984106 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c35dc531-b39e-4fac-ba5b-f6d5fee1fef1 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:06.993864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c35dc531-b39e-4fac-ba5b-f6d5fee1fef1 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:06.994613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c35dc531-b39e-4fac-ba5b-f6d5fee1fef1 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:06.995702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c35dc531-b39e-4fac-ba5b-f6d5fee1fef1 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:06.996571 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c35dc531-b39e-4fac-ba5b-f6d5fee1fef1 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:07.089973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c35dc531-b39e-4fac-ba5b-f6d5fee1fef1 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:07.090735 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c35dc531-b39e-4fac-ba5b-f6d5fee1fef1 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:07.091446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-c35dc531-b39e-4fac-ba5b-f6d5fee1fef1 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lazy-loading 'fault' on Instance uuid 5b779469-1f62-473f-adda-86fc33a0e8df {{(pid=94298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:07:07.189891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c35dc531-b39e-4fac-ba5b-f6d5fee1fef1 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:07.203880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c35dc531-b39e-4fac-ba5b-f6d5fee1fef1 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1307 microversion: 2.1 time: 0.229766 Dec 21 04:07:07.204798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 290/578] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:06 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:07.472444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4ee5e6ad-608d-4df1-b4b1-fb8de979bd4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:07.492892 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4ee5e6ad-608d-4df1-b4b1-fb8de979bd4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1712 microversion: 2.1 time: 0.736470 Dec 21 04:07:07.494010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 289/579] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:06 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1712 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:07.791064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8fdc8d17-decd-455e-aba3-4c798a8bd2cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:07.791840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8fdc8d17-decd-455e-aba3-4c798a8bd2cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:07.801759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8fdc8d17-decd-455e-aba3-4c798a8bd2cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:07.802280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8fdc8d17-decd-455e-aba3-4c798a8bd2cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:07.803334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8fdc8d17-decd-455e-aba3-4c798a8bd2cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:07.803982 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8fdc8d17-decd-455e-aba3-4c798a8bd2cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:08.033980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8fdc8d17-decd-455e-aba3-4c798a8bd2cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:08.049721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8fdc8d17-decd-455e-aba3-4c798a8bd2cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:08.056539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8fdc8d17-decd-455e-aba3-4c798a8bd2cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:08.057740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8fdc8d17-decd-455e-aba3-4c798a8bd2cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1753 microversion: 2.20 time: 0.276891 Dec 21 04:07:08.058332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 291/580] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:07 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1753 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:08.233046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1cc1606b-8523-43ff-b34a-4dd50bed2c93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:08.234133 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1cc1606b-8523-43ff-b34a-4dd50bed2c93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:08.245466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1cc1606b-8523-43ff-b34a-4dd50bed2c93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:08.246995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1cc1606b-8523-43ff-b34a-4dd50bed2c93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:08.248565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1cc1606b-8523-43ff-b34a-4dd50bed2c93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:08.249516 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1cc1606b-8523-43ff-b34a-4dd50bed2c93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:08.370679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1cc1606b-8523-43ff-b34a-4dd50bed2c93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:08.371215 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1cc1606b-8523-43ff-b34a-4dd50bed2c93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:08.371764 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-1cc1606b-8523-43ff-b34a-4dd50bed2c93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lazy-loading 'fault' on Instance uuid 5b779469-1f62-473f-adda-86fc33a0e8df {{(pid=94299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:07:08.465432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1cc1606b-8523-43ff-b34a-4dd50bed2c93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:08.479696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1cc1606b-8523-43ff-b34a-4dd50bed2c93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 200 len: 1307 microversion: 2.1 time: 0.261328 Dec 21 04:07:08.481871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 290/581] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:08 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 1307 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:08.517373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f5fcb4f4-57ec-46b4-9ccc-ff70e01a20f7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:08.518047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f5fcb4f4-57ec-46b4-9ccc-ff70e01a20f7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:08.533256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5fcb4f4-57ec-46b4-9ccc-ff70e01a20f7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:08.534225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5fcb4f4-57ec-46b4-9ccc-ff70e01a20f7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:08.535965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5fcb4f4-57ec-46b4-9ccc-ff70e01a20f7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:08.536763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5fcb4f4-57ec-46b4-9ccc-ff70e01a20f7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:08.792782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f5fcb4f4-57ec-46b4-9ccc-ff70e01a20f7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:08.803951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f5fcb4f4-57ec-46b4-9ccc-ff70e01a20f7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1712 microversion: 2.1 time: 0.295981 Dec 21 04:07:08.814924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 292/582] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:08 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1712 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:09.082262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d07255c4-c7d5-4a4e-94cf-cd0a6e74de96 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:09.086647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d07255c4-c7d5-4a4e-94cf-cd0a6e74de96 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:09.105185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d07255c4-c7d5-4a4e-94cf-cd0a6e74de96 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:09.107626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d07255c4-c7d5-4a4e-94cf-cd0a6e74de96 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:09.109836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d07255c4-c7d5-4a4e-94cf-cd0a6e74de96 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:09.112323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d07255c4-c7d5-4a4e-94cf-cd0a6e74de96 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:09.520728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-169cdc25-ccd8-4027-bde5-86fb5a2c0f38 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:09.524489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-169cdc25-ccd8-4027-bde5-86fb5a2c0f38 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 5b779469-1f62-473f-adda-86fc33a0e8df] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:09.538740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-169cdc25-ccd8-4027-bde5-86fb5a2c0f38 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:09.545613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-169cdc25-ccd8-4027-bde5-86fb5a2c0f38 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:09.546675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-169cdc25-ccd8-4027-bde5-86fb5a2c0f38 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:09.547329 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-169cdc25-ccd8-4027-bde5-86fb5a2c0f38 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:09.675422 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-169cdc25-ccd8-4027-bde5-86fb5a2c0f38 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] HTTP exception thrown: Instance 5b779469-1f62-473f-adda-86fc33a0e8df could not be found. Dec 21 04:07:09.676808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-169cdc25-ccd8-4027-bde5-86fb5a2c0f38 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Returning 404 to user: Instance 5b779469-1f62-473f-adda-86fc33a0e8df could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:07:09.684095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-169cdc25-ccd8-4027-bde5-86fb5a2c0f38 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df" status: 404 len: 111 microversion: 2.1 time: 0.188512 Dec 21 04:07:09.685280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 293/583] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:09 2020] GET /compute/v2.1/servers/5b779469-1f62-473f-adda-86fc33a0e8df => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:07:09.708194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-06a7bef8-2dac-45cb-b801-fe919cee52af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:09.709074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-06a7bef8-2dac-45cb-b801-fe919cee52af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:09.728259 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-06a7bef8-2dac-45cb-b801-fe919cee52af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:09.730619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-06a7bef8-2dac-45cb-b801-fe919cee52af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:09.731737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-06a7bef8-2dac-45cb-b801-fe919cee52af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:09.734564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-06a7bef8-2dac-45cb-b801-fe919cee52af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:09.871130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-06a7bef8-2dac-45cb-b801-fe919cee52af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Going to try to terminate instance {{(pid=94298) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:07:09.923926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d07255c4-c7d5-4a4e-94cf-cd0a6e74de96 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:09.955456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d07255c4-c7d5-4a4e-94cf-cd0a6e74de96 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:09.969879 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d07255c4-c7d5-4a4e-94cf-cd0a6e74de96 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:09.971598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d07255c4-c7d5-4a4e-94cf-cd0a6e74de96 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1753 microversion: 2.20 time: 0.898679 Dec 21 04:07:09.984081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 291/584] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:09 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1753 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:10.008368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-903fa0fd-88c5-42a2-bcfc-fa7d05f0a18b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:10.009809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-903fa0fd-88c5-42a2-bcfc-fa7d05f0a18b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:10.023160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-903fa0fd-88c5-42a2-bcfc-fa7d05f0a18b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:10.024438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-903fa0fd-88c5-42a2-bcfc-fa7d05f0a18b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:10.025438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-903fa0fd-88c5-42a2-bcfc-fa7d05f0a18b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:10.026081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-903fa0fd-88c5-42a2-bcfc-fa7d05f0a18b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:10.073240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-06a7bef8-2dac-45cb-b801-fe919cee52af tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "DELETE /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 204 len: 0 microversion: 2.1 time: 0.383619 Dec 21 04:07:10.074359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 294/585] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:07:09 2020] DELETE /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 21 04:07:10.093317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c1b7544f-b257-4b53-8ea7-738a811f0b96 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:10.102112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c1b7544f-b257-4b53-8ea7-738a811f0b96 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:10.122522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1b7544f-b257-4b53-8ea7-738a811f0b96 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:10.124884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1b7544f-b257-4b53-8ea7-738a811f0b96 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:10.126765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1b7544f-b257-4b53-8ea7-738a811f0b96 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:10.128080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1b7544f-b257-4b53-8ea7-738a811f0b96 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:10.621916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c1b7544f-b257-4b53-8ea7-738a811f0b96 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:10.631889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c1b7544f-b257-4b53-8ea7-738a811f0b96 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1513 microversion: 2.1 time: 0.552615 Dec 21 04:07:10.641475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 295/586] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:10 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1513 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:10.758523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-903fa0fd-88c5-42a2-bcfc-fa7d05f0a18b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:10.769314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-903fa0fd-88c5-42a2-bcfc-fa7d05f0a18b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1712 microversion: 2.1 time: 0.783026 Dec 21 04:07:10.770046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 292/587] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:09 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1712 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:11.012836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e075d99b-7d00-4911-8ad6-b2df87860e5f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:11.013486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e075d99b-7d00-4911-8ad6-b2df87860e5f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:11.024401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e075d99b-7d00-4911-8ad6-b2df87860e5f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:11.025263 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e075d99b-7d00-4911-8ad6-b2df87860e5f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:11.026131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e075d99b-7d00-4911-8ad6-b2df87860e5f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:11.026825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e075d99b-7d00-4911-8ad6-b2df87860e5f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:11.309282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e075d99b-7d00-4911-8ad6-b2df87860e5f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:11.330859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e075d99b-7d00-4911-8ad6-b2df87860e5f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:11.339294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e075d99b-7d00-4911-8ad6-b2df87860e5f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:11.341124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e075d99b-7d00-4911-8ad6-b2df87860e5f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1753 microversion: 2.20 time: 0.339827 Dec 21 04:07:11.342939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 296/588] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:10 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1753 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:11.656215 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-521a22d5-fc70-40b3-bab3-0403f9958595 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:11.656806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-521a22d5-fc70-40b3-bab3-0403f9958595 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:11.665861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-521a22d5-fc70-40b3-bab3-0403f9958595 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:11.666366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-521a22d5-fc70-40b3-bab3-0403f9958595 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:11.667228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-521a22d5-fc70-40b3-bab3-0403f9958595 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:11.667717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-521a22d5-fc70-40b3-bab3-0403f9958595 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:11.792776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a2970b0b-aeac-4f5e-b797-1b7d94c32a8e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:11.793461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a2970b0b-aeac-4f5e-b797-1b7d94c32a8e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:11.802089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a2970b0b-aeac-4f5e-b797-1b7d94c32a8e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:11.802604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a2970b0b-aeac-4f5e-b797-1b7d94c32a8e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:11.803490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a2970b0b-aeac-4f5e-b797-1b7d94c32a8e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:11.804917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a2970b0b-aeac-4f5e-b797-1b7d94c32a8e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:12.063641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a2970b0b-aeac-4f5e-b797-1b7d94c32a8e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:12.074362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a2970b0b-aeac-4f5e-b797-1b7d94c32a8e tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1712 microversion: 2.1 time: 0.290771 Dec 21 04:07:12.074916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 297/589] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:11 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1712 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:12.116362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-521a22d5-fc70-40b3-bab3-0403f9958595 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:12.125662 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-521a22d5-fc70-40b3-bab3-0403f9958595 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1513 microversion: 2.1 time: 0.478901 Dec 21 04:07:12.126257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 293/590] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:11 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1513 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:12.368552 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-57b63ced-ee54-44a0-bab8-7718516242cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:12.369336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-57b63ced-ee54-44a0-bab8-7718516242cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:12.377342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-57b63ced-ee54-44a0-bab8-7718516242cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:12.377858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-57b63ced-ee54-44a0-bab8-7718516242cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:12.379217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-57b63ced-ee54-44a0-bab8-7718516242cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:12.380115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-57b63ced-ee54-44a0-bab8-7718516242cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:12.655801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-57b63ced-ee54-44a0-bab8-7718516242cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:12.670985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-57b63ced-ee54-44a0-bab8-7718516242cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:12.678486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-57b63ced-ee54-44a0-bab8-7718516242cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:12.679749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-57b63ced-ee54-44a0-bab8-7718516242cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1753 microversion: 2.20 time: 0.320942 Dec 21 04:07:12.680388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 298/591] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:12 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1753 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:13.099418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-75e5fab1-0b83-412c-998f-7523bd291296 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:13.100096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-75e5fab1-0b83-412c-998f-7523bd291296 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:13.108561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75e5fab1-0b83-412c-998f-7523bd291296 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:13.109206 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75e5fab1-0b83-412c-998f-7523bd291296 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:13.110040 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75e5fab1-0b83-412c-998f-7523bd291296 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:13.110532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75e5fab1-0b83-412c-998f-7523bd291296 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:13.155098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7d949e7c-7722-4e99-b6e1-d3ed8588d3a6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:13.155813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7d949e7c-7722-4e99-b6e1-d3ed8588d3a6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:13.164732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d949e7c-7722-4e99-b6e1-d3ed8588d3a6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:13.165252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d949e7c-7722-4e99-b6e1-d3ed8588d3a6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:13.166107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d949e7c-7722-4e99-b6e1-d3ed8588d3a6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:13.166656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d949e7c-7722-4e99-b6e1-d3ed8588d3a6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:13.343868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-75e5fab1-0b83-412c-998f-7523bd291296 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:13.354562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-75e5fab1-0b83-412c-998f-7523bd291296 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1716 microversion: 2.1 time: 0.266099 Dec 21 04:07:13.355183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 294/592] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:13 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1716 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:13.439115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7d949e7c-7722-4e99-b6e1-d3ed8588d3a6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:13.450159 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7d949e7c-7722-4e99-b6e1-d3ed8588d3a6 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1513 microversion: 2.1 time: 0.309775 Dec 21 04:07:13.451126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 299/593] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:13 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:13.705314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ebdbb3ee-8ee9-44ab-8b4c-7ebe9afb932c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:13.706289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ebdbb3ee-8ee9-44ab-8b4c-7ebe9afb932c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:13.716072 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebdbb3ee-8ee9-44ab-8b4c-7ebe9afb932c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:13.716802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebdbb3ee-8ee9-44ab-8b4c-7ebe9afb932c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:13.717739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebdbb3ee-8ee9-44ab-8b4c-7ebe9afb932c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:13.718317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebdbb3ee-8ee9-44ab-8b4c-7ebe9afb932c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:14.301772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ebdbb3ee-8ee9-44ab-8b4c-7ebe9afb932c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:14.337227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ebdbb3ee-8ee9-44ab-8b4c-7ebe9afb932c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:14.353345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ebdbb3ee-8ee9-44ab-8b4c-7ebe9afb932c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:14.354630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ebdbb3ee-8ee9-44ab-8b4c-7ebe9afb932c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.658679 Dec 21 04:07:14.367016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 295/594] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:13 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:14.491389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-43b4f9e1-4ca1-4b57-93b1-9cfc3d294958 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:14.492046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-43b4f9e1-4ca1-4b57-93b1-9cfc3d294958 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:14.513554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-43b4f9e1-4ca1-4b57-93b1-9cfc3d294958 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:14.518807 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-43b4f9e1-4ca1-4b57-93b1-9cfc3d294958 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:14.525719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-43b4f9e1-4ca1-4b57-93b1-9cfc3d294958 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:14.526408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-43b4f9e1-4ca1-4b57-93b1-9cfc3d294958 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:14.810551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-43b4f9e1-4ca1-4b57-93b1-9cfc3d294958 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:14.822142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-43b4f9e1-4ca1-4b57-93b1-9cfc3d294958 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1513 microversion: 2.1 time: 0.356651 Dec 21 04:07:14.833411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 300/595] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:14 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1513 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:15.399665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e7916df4-64a9-4c75-9a1f-e35a3713515d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:15.400341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e7916df4-64a9-4c75-9a1f-e35a3713515d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:15.413500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e7916df4-64a9-4c75-9a1f-e35a3713515d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:15.414265 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e7916df4-64a9-4c75-9a1f-e35a3713515d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:15.415299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e7916df4-64a9-4c75-9a1f-e35a3713515d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:15.416036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e7916df4-64a9-4c75-9a1f-e35a3713515d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:15.872131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a3597aa3-845e-4cdb-9d5a-7ca9dc8a4084 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:15.872929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a3597aa3-845e-4cdb-9d5a-7ca9dc8a4084 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:15.886480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e7916df4-64a9-4c75-9a1f-e35a3713515d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:15.894876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a3597aa3-845e-4cdb-9d5a-7ca9dc8a4084 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:15.895416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a3597aa3-845e-4cdb-9d5a-7ca9dc8a4084 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:15.896257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a3597aa3-845e-4cdb-9d5a-7ca9dc8a4084 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:15.899580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a3597aa3-845e-4cdb-9d5a-7ca9dc8a4084 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:15.917927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e7916df4-64a9-4c75-9a1f-e35a3713515d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:15.926323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e7916df4-64a9-4c75-9a1f-e35a3713515d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:15.927914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e7916df4-64a9-4c75-9a1f-e35a3713515d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.546283 Dec 21 04:07:15.930594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 296/596] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:15 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:16.238235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a3597aa3-845e-4cdb-9d5a-7ca9dc8a4084 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:16.280590 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a3597aa3-845e-4cdb-9d5a-7ca9dc8a4084 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1513 microversion: 2.1 time: 0.440979 Dec 21 04:07:16.281639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 301/597] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:15 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1513 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:16.953745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-93f60239-3873-42a1-b14f-e485155bda60 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:16.954313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-93f60239-3873-42a1-b14f-e485155bda60 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:16.973768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93f60239-3873-42a1-b14f-e485155bda60 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:16.975518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93f60239-3873-42a1-b14f-e485155bda60 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:16.977669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93f60239-3873-42a1-b14f-e485155bda60 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:16.980789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93f60239-3873-42a1-b14f-e485155bda60 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:17.272183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-93f60239-3873-42a1-b14f-e485155bda60 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:17.296230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-93f60239-3873-42a1-b14f-e485155bda60 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:17.305028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-93f60239-3873-42a1-b14f-e485155bda60 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:17.306535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-93f60239-3873-42a1-b14f-e485155bda60 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.362552 Dec 21 04:07:17.308298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 297/598] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:16 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:17.316549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-49316258-ad80-4b8a-8f00-ebcf0378af93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:17.318093 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-49316258-ad80-4b8a-8f00-ebcf0378af93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:17.327926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49316258-ad80-4b8a-8f00-ebcf0378af93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:17.328779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49316258-ad80-4b8a-8f00-ebcf0378af93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:17.329797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49316258-ad80-4b8a-8f00-ebcf0378af93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:17.330503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49316258-ad80-4b8a-8f00-ebcf0378af93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:17.609115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-49316258-ad80-4b8a-8f00-ebcf0378af93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:17.620216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-49316258-ad80-4b8a-8f00-ebcf0378af93 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1513 microversion: 2.1 time: 0.319566 Dec 21 04:07:17.621351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 302/599] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:17 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1513 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:18.366764 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-56282143-ba49-4c72-8b59-04ec98fff739 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:18.367475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-56282143-ba49-4c72-8b59-04ec98fff739 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:18.386657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56282143-ba49-4c72-8b59-04ec98fff739 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:18.387286 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56282143-ba49-4c72-8b59-04ec98fff739 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:18.391881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56282143-ba49-4c72-8b59-04ec98fff739 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:18.392595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56282143-ba49-4c72-8b59-04ec98fff739 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:18.644033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8220b725-88a4-4bcb-aafe-9c5958894a16 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:18.655961 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8220b725-88a4-4bcb-aafe-9c5958894a16 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:18.671461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8220b725-88a4-4bcb-aafe-9c5958894a16 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:18.673786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8220b725-88a4-4bcb-aafe-9c5958894a16 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:18.675616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8220b725-88a4-4bcb-aafe-9c5958894a16 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:18.692321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8220b725-88a4-4bcb-aafe-9c5958894a16 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:19.149168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8220b725-88a4-4bcb-aafe-9c5958894a16 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:19.160099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8220b725-88a4-4bcb-aafe-9c5958894a16 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1513 microversion: 2.1 time: 0.526216 Dec 21 04:07:19.160860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 303/600] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:18 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1513 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:19.166029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-56282143-ba49-4c72-8b59-04ec98fff739 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:19.192237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-56282143-ba49-4c72-8b59-04ec98fff739 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:19.199915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-56282143-ba49-4c72-8b59-04ec98fff739 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:19.201458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-56282143-ba49-4c72-8b59-04ec98fff739 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.862121 Dec 21 04:07:19.202195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 298/601] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:18 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:19.307267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-81379f3e-cd23-4f68-9248-e6e2286eb911 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:19.310419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-81379f3e-cd23-4f68-9248-e6e2286eb911 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:19.321584 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81379f3e-cd23-4f68-9248-e6e2286eb911 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:19.322208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81379f3e-cd23-4f68-9248-e6e2286eb911 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:19.323182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81379f3e-cd23-4f68-9248-e6e2286eb911 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:19.323770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81379f3e-cd23-4f68-9248-e6e2286eb911 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:19.439387 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-81379f3e-cd23-4f68-9248-e6e2286eb911 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Going to try to terminate instance {{(pid=94298) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:07:19.695167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-81379f3e-cd23-4f68-9248-e6e2286eb911 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "DELETE /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 204 len: 0 microversion: 2.1 time: 0.401646 Dec 21 04:07:19.696861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 304/602] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:07:19 2020] DELETE /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:07:19.710345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e3be9866-08e7-4f43-a47b-42e47a212107 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:19.711536 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e3be9866-08e7-4f43-a47b-42e47a212107 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:19.734530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3be9866-08e7-4f43-a47b-42e47a212107 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:19.735256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3be9866-08e7-4f43-a47b-42e47a212107 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:19.735914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3be9866-08e7-4f43-a47b-42e47a212107 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:19.736419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3be9866-08e7-4f43-a47b-42e47a212107 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:20.113865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e3be9866-08e7-4f43-a47b-42e47a212107 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:20.125084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e3be9866-08e7-4f43-a47b-42e47a212107 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 0.424094 Dec 21 04:07:20.133855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 299/603] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:19 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:20.186287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-01ac9817-7bb8-4ebd-8bc1-88d495bfefd3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:20.187107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-01ac9817-7bb8-4ebd-8bc1-88d495bfefd3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:20.230607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-01ac9817-7bb8-4ebd-8bc1-88d495bfefd3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:20.231162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-01ac9817-7bb8-4ebd-8bc1-88d495bfefd3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:20.232033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-01ac9817-7bb8-4ebd-8bc1-88d495bfefd3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:20.232531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-01ac9817-7bb8-4ebd-8bc1-88d495bfefd3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:20.241362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-35ee7a72-fe04-47aa-8f62-732d7e9c5092 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:20.242157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-35ee7a72-fe04-47aa-8f62-732d7e9c5092 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:20.262889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-35ee7a72-fe04-47aa-8f62-732d7e9c5092 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:20.271382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-35ee7a72-fe04-47aa-8f62-732d7e9c5092 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:20.276723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-35ee7a72-fe04-47aa-8f62-732d7e9c5092 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:20.277431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-35ee7a72-fe04-47aa-8f62-732d7e9c5092 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:20.682697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-01ac9817-7bb8-4ebd-8bc1-88d495bfefd3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:20.701616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-01ac9817-7bb8-4ebd-8bc1-88d495bfefd3 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1513 microversion: 2.1 time: 0.527469 Dec 21 04:07:20.702250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 305/604] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:20 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1513 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:20.780540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-35ee7a72-fe04-47aa-8f62-732d7e9c5092 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:20.817827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-35ee7a72-fe04-47aa-8f62-732d7e9c5092 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:20.825560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-35ee7a72-fe04-47aa-8f62-732d7e9c5092 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:20.827019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-35ee7a72-fe04-47aa-8f62-732d7e9c5092 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.609261 Dec 21 04:07:20.827809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 300/605] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:20 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:21.167425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-39272b3f-cf1a-4b69-9703-3f3cea6e175f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:21.167425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-39272b3f-cf1a-4b69-9703-3f3cea6e175f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:21.167425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-39272b3f-cf1a-4b69-9703-3f3cea6e175f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:21.189162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-39272b3f-cf1a-4b69-9703-3f3cea6e175f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:21.189162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-39272b3f-cf1a-4b69-9703-3f3cea6e175f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:21.189162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-39272b3f-cf1a-4b69-9703-3f3cea6e175f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:21.507742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-39272b3f-cf1a-4b69-9703-3f3cea6e175f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:21.528608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-39272b3f-cf1a-4b69-9703-3f3cea6e175f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 0.388048 Dec 21 04:07:21.539005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 306/606] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:21 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:21.727393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-abf2d81f-3ea0-4314-afae-01a410e1c391 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:21.728942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-abf2d81f-3ea0-4314-afae-01a410e1c391 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:21.741354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abf2d81f-3ea0-4314-afae-01a410e1c391 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:21.742035 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abf2d81f-3ea0-4314-afae-01a410e1c391 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:21.743435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abf2d81f-3ea0-4314-afae-01a410e1c391 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:21.744583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-abf2d81f-3ea0-4314-afae-01a410e1c391 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:21.851569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-815f8044-9a14-4cc0-863c-1240b5682060 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:21.852179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-815f8044-9a14-4cc0-863c-1240b5682060 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:21.874521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-815f8044-9a14-4cc0-863c-1240b5682060 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:21.875085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-815f8044-9a14-4cc0-863c-1240b5682060 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:21.875947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-815f8044-9a14-4cc0-863c-1240b5682060 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:21.876434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-815f8044-9a14-4cc0-863c-1240b5682060 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:22.259189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-abf2d81f-3ea0-4314-afae-01a410e1c391 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:22.281478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-abf2d81f-3ea0-4314-afae-01a410e1c391 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1513 microversion: 2.1 time: 0.563939 Dec 21 04:07:22.282081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 301/607] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:21 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1513 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:22.373070 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-815f8044-9a14-4cc0-863c-1240b5682060 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:22.390197 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-815f8044-9a14-4cc0-863c-1240b5682060 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:22.398084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-815f8044-9a14-4cc0-863c-1240b5682060 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:22.399710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-815f8044-9a14-4cc0-863c-1240b5682060 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.558022 Dec 21 04:07:22.413208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 307/608] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:21 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:22.557363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1f436af8-e51b-4300-a804-ef305d904604 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:22.558407 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1f436af8-e51b-4300-a804-ef305d904604 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:22.568070 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1f436af8-e51b-4300-a804-ef305d904604 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:22.568795 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1f436af8-e51b-4300-a804-ef305d904604 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:22.569996 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1f436af8-e51b-4300-a804-ef305d904604 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:22.570702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1f436af8-e51b-4300-a804-ef305d904604 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:22.728928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f464c647-3061-4e8c-8c8a-f9d43547ac85 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:22.729614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f464c647-3061-4e8c-8c8a-f9d43547ac85 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:22.753623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f464c647-3061-4e8c-8c8a-f9d43547ac85 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:22.754218 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f464c647-3061-4e8c-8c8a-f9d43547ac85 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:22.755199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f464c647-3061-4e8c-8c8a-f9d43547ac85 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:22.755701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f464c647-3061-4e8c-8c8a-f9d43547ac85 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:22.922939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1f436af8-e51b-4300-a804-ef305d904604 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:22.947729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1f436af8-e51b-4300-a804-ef305d904604 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 0.400931 Dec 21 04:07:22.948637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 302/609] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:22 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:23.234453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f464c647-3061-4e8c-8c8a-f9d43547ac85 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "DELETE /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4/os-volume_attachments/e6665fd8-b55e-4ba2-afe2-fb67faeb33ed" status: 202 len: 0 microversion: 2.1 time: 0.516621 Dec 21 04:07:23.239082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 308/610] 10.222.0.16 () {58 vars in 1406 bytes} [Mon Dec 21 04:07:22 2020] DELETE /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4/os-volume_attachments/e6665fd8-b55e-4ba2-afe2-fb67faeb33ed => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:07:23.310611 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b568ae36-269b-4ca7-9df9-8338fd38aa39 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:23.315239 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b568ae36-269b-4ca7-9df9-8338fd38aa39 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:23.338714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-62766c2e-c378-498f-ac96-f20362373743 req-a7d6237c-f154-49f3-b5c2-3e04a574aef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2eb7e97-5d80-4ff6-9f49-1ff46651638d", "name": "network-vif-unplugged", "status": "completed", "tag": "6f38357c-d2bf-4d17-b4b1-51ede0023daf"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:23.343497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b568ae36-269b-4ca7-9df9-8338fd38aa39 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:23.345733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b568ae36-269b-4ca7-9df9-8338fd38aa39 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:23.347429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b568ae36-269b-4ca7-9df9-8338fd38aa39 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:23.353636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b568ae36-269b-4ca7-9df9-8338fd38aa39 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:23.354017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:23.354017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:07:23.380108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-62766c2e-c378-498f-ac96-f20362373743 req-a7d6237c-f154-49f3-b5c2-3e04a574aef8 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:23.380943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-62766c2e-c378-498f-ac96-f20362373743 req-a7d6237c-f154-49f3-b5c2-3e04a574aef8 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:23.461322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-62766c2e-c378-498f-ac96-f20362373743 req-a7d6237c-f154-49f3-b5c2-3e04a574aef8 service nova] Creating event network-vif-unplugged:6f38357c-d2bf-4d17-b4b1-51ede0023daf for instance f2eb7e97-5d80-4ff6-9f49-1ff46651638d on hv-cinder-73306 Dec 21 04:07:23.480781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-62766c2e-c378-498f-ac96-f20362373743 req-a7d6237c-f154-49f3-b5c2-3e04a574aef8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159038 Dec 21 04:07:23.481956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 309/611] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:07:23 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:07:23.530577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7e878ab6-e22a-4eb6-94c8-b1992eee1800 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:23.531928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7e878ab6-e22a-4eb6-94c8-b1992eee1800 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:23.557429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e878ab6-e22a-4eb6-94c8-b1992eee1800 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:23.558131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e878ab6-e22a-4eb6-94c8-b1992eee1800 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:23.559188 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e878ab6-e22a-4eb6-94c8-b1992eee1800 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:23.561023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e878ab6-e22a-4eb6-94c8-b1992eee1800 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:23.877432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b568ae36-269b-4ca7-9df9-8338fd38aa39 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:23.889284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b568ae36-269b-4ca7-9df9-8338fd38aa39 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1513 microversion: 2.1 time: 0.591193 Dec 21 04:07:23.890164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 303/612] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:23 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1513 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:23.980837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e7315c71-1a93-40c8-950f-a82091311639 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:23.986380 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e7315c71-1a93-40c8-950f-a82091311639 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:24.052646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e7315c71-1a93-40c8-950f-a82091311639 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:24.060600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e7315c71-1a93-40c8-950f-a82091311639 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:24.061860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e7315c71-1a93-40c8-950f-a82091311639 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:24.062557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e7315c71-1a93-40c8-950f-a82091311639 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:24.429528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7e878ab6-e22a-4eb6-94c8-b1992eee1800 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:24.469046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7e878ab6-e22a-4eb6-94c8-b1992eee1800 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:24.482810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7e878ab6-e22a-4eb6-94c8-b1992eee1800 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:24.492717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7e878ab6-e22a-4eb6-94c8-b1992eee1800 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 1.004257 Dec 21 04:07:24.495508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 310/613] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:23 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:24.678773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e7315c71-1a93-40c8-950f-a82091311639 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:24.701405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e7315c71-1a93-40c8-950f-a82091311639 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 0.739259 Dec 21 04:07:24.702456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 304/614] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:23 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:24.920613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a5c4122b-e9d5-46cd-b672-1fe368d8edc4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:24.923447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a5c4122b-e9d5-46cd-b672-1fe368d8edc4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:24.945479 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5c4122b-e9d5-46cd-b672-1fe368d8edc4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:24.945967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5c4122b-e9d5-46cd-b672-1fe368d8edc4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:24.946981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5c4122b-e9d5-46cd-b672-1fe368d8edc4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:24.951116 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5c4122b-e9d5-46cd-b672-1fe368d8edc4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:24.996051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-0c703abd-1e7b-4147-83b6-3214c43e9e13 req-d9a9808f-7ca2-4f93-90a9-c4227996222d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2eb7e97-5d80-4ff6-9f49-1ff46651638d", "name": "network-vif-deleted", "tag": "6f38357c-d2bf-4d17-b4b1-51ede0023daf"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:25.006061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:25.006061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:07:25.016220 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-0c703abd-1e7b-4147-83b6-3214c43e9e13 req-d9a9808f-7ca2-4f93-90a9-c4227996222d service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:25.016718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-0c703abd-1e7b-4147-83b6-3214c43e9e13 req-d9a9808f-7ca2-4f93-90a9-c4227996222d service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:25.041939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-0c703abd-1e7b-4147-83b6-3214c43e9e13 req-d9a9808f-7ca2-4f93-90a9-c4227996222d service nova] Creating event network-vif-deleted:6f38357c-d2bf-4d17-b4b1-51ede0023daf for instance f2eb7e97-5d80-4ff6-9f49-1ff46651638d on hv-cinder-73306 Dec 21 04:07:25.060733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-0c703abd-1e7b-4147-83b6-3214c43e9e13 req-d9a9808f-7ca2-4f93-90a9-c4227996222d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075497 Dec 21 04:07:25.061412 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 305/615] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:07:24 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:07:25.181230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a5c4122b-e9d5-46cd-b672-1fe368d8edc4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:25.198655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a5c4122b-e9d5-46cd-b672-1fe368d8edc4 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1471 microversion: 2.1 time: 0.294412 Dec 21 04:07:25.199514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 311/616] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:24 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1471 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:25.448955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d68e6b77-f015-494b-97cf-03135cb73a3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Action: 'create', calling method: .version_select at 0x7f2bb84ef8c8>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1283495731"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:25.522466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c1e4f3f5-6b62-4c9e-a52e-2534d6b7732c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:25.532853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c1e4f3f5-6b62-4c9e-a52e-2534d6b7732c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:25.542708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1e4f3f5-6b62-4c9e-a52e-2534d6b7732c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:25.543395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1e4f3f5-6b62-4c9e-a52e-2534d6b7732c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:25.544452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1e4f3f5-6b62-4c9e-a52e-2534d6b7732c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:25.545485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1e4f3f5-6b62-4c9e-a52e-2534d6b7732c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:25.627149 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-d68e6b77-f015-494b-97cf-03135cb73a3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Getting quotas for project c854b1b3076d4532ac6b8813b4df1ab6. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:07:25.642491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-d68e6b77-f015-494b-97cf-03135cb73a3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Getting quotas for user 9ae86a8c255940a8b6352ee2b9e1e8d5 and project c854b1b3076d4532ac6b8813b4df1ab6. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:07:25.886011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c1e4f3f5-6b62-4c9e-a52e-2534d6b7732c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:25.937643 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c1e4f3f5-6b62-4c9e-a52e-2534d6b7732c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:25.956944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:07:25.957389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:07:25 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de (ip 10.222.0.16) !!! Dec 21 04:07:25.982147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c1e4f3f5-6b62-4c9e-a52e-2534d6b7732c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:25.983749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c1e4f3f5-6b62-4c9e-a52e-2534d6b7732c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.471670 Dec 21 04:07:25.984527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 312/617] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:25 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:25.994821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-16011a9d-7149-4524-b44d-5404399289b1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:25.996690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-16011a9d-7149-4524-b44d-5404399289b1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:26.013509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16011a9d-7149-4524-b44d-5404399289b1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:26.019024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16011a9d-7149-4524-b44d-5404399289b1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:26.020283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16011a9d-7149-4524-b44d-5404399289b1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:26.021013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16011a9d-7149-4524-b44d-5404399289b1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:26.285732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-16011a9d-7149-4524-b44d-5404399289b1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:26.297202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-16011a9d-7149-4524-b44d-5404399289b1 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 0.311389 Dec 21 04:07:26.298482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 313/618] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:25 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:26.310617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6ec80df1-d334-4aef-a831-31760011d9e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:26.311644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6ec80df1-d334-4aef-a831-31760011d9e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:26.320315 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ec80df1-d334-4aef-a831-31760011d9e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:26.321508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ec80df1-d334-4aef-a831-31760011d9e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:26.322584 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ec80df1-d334-4aef-a831-31760011d9e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:26.323361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ec80df1-d334-4aef-a831-31760011d9e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:26.402423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6ec80df1-d334-4aef-a831-31760011d9e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Going to try to terminate instance {{(pid=94298) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:07:26.434765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-d68e6b77-f015-494b-97cf-03135cb73a3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Getting quotas for project c854b1b3076d4532ac6b8813b4df1ab6. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:07:26.439241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-d68e6b77-f015-494b-97cf-03135cb73a3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Getting quotas for user 9ae86a8c255940a8b6352ee2b9e1e8d5 and project c854b1b3076d4532ac6b8813b4df1ab6. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:07:26.463707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d68e6b77-f015-494b-97cf-03135cb73a3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 1.025232 Dec 21 04:07:26.464596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 306/619] 10.222.0.16 () {60 vars in 1148 bytes} [Mon Dec 21 04:07:25 2020] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:26.508822 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-664f3f88-dcf5-4dc4-aaac-43017f4eb0ae tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:26.509696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-664f3f88-dcf5-4dc4-aaac-43017f4eb0ae tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:26.526277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-664f3f88-dcf5-4dc4-aaac-43017f4eb0ae tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:26.526785 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-664f3f88-dcf5-4dc4-aaac-43017f4eb0ae tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:26.527792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-664f3f88-dcf5-4dc4-aaac-43017f4eb0ae tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:26.528289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-664f3f88-dcf5-4dc4-aaac-43017f4eb0ae tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:26.650797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6ec80df1-d334-4aef-a831-31760011d9e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "DELETE /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 204 len: 0 microversion: 2.1 time: 0.349360 Dec 21 04:07:26.651626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 314/620] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:07:26 2020] DELETE /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:07:26.664096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1697819038", "imageRef": "001914d0-f5f6-49c7-9ff1-2ea9f69caa02", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1283495731", "networks": [{"uuid": "78dad1cc-329d-4b16-a292-99bbc6a23af7"}]}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:26.762307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-664f3f88-dcf5-4dc4-aaac-43017f4eb0ae tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:26.771988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-664f3f88-dcf5-4dc4-aaac-43017f4eb0ae tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1302 microversion: 2.1 time: 0.306475 Dec 21 04:07:26.772792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 307/621] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:26 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1302 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:26.783143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5e9d84cf-a0f8-417a-b9b8-af8668767fa8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:26.784501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5e9d84cf-a0f8-417a-b9b8-af8668767fa8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:26.793144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e9d84cf-a0f8-417a-b9b8-af8668767fa8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:26.793798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e9d84cf-a0f8-417a-b9b8-af8668767fa8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:26.794827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e9d84cf-a0f8-417a-b9b8-af8668767fa8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:26.795456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e9d84cf-a0f8-417a-b9b8-af8668767fa8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:27.167756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5e9d84cf-a0f8-417a-b9b8-af8668767fa8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:27.182219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5e9d84cf-a0f8-417a-b9b8-af8668767fa8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1560 microversion: 2.1 time: 0.407954 Dec 21 04:07:27.183132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 308/622] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:26 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1560 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:27.196590 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d7264552-2441-4811-b686-03273237cec4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:27.197287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d7264552-2441-4811-b686-03273237cec4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:27.206840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d7264552-2441-4811-b686-03273237cec4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:27.207383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d7264552-2441-4811-b686-03273237cec4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:27.208237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d7264552-2441-4811-b686-03273237cec4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:27.208737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d7264552-2441-4811-b686-03273237cec4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:27.468822 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d7264552-2441-4811-b686-03273237cec4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:27.494940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d7264552-2441-4811-b686-03273237cec4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:27.501837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d7264552-2441-4811-b686-03273237cec4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:27.504111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d7264552-2441-4811-b686-03273237cec4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.319890 Dec 21 04:07:27.516787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 309/623] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:27 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:27.528550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6688e790-2330-4f57-9807-ee2e787c4abc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:27.528550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6688e790-2330-4f57-9807-ee2e787c4abc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:27.542523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6688e790-2330-4f57-9807-ee2e787c4abc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:27.543082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6688e790-2330-4f57-9807-ee2e787c4abc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:27.543985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6688e790-2330-4f57-9807-ee2e787c4abc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:27.544413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6688e790-2330-4f57-9807-ee2e787c4abc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:27.827911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6688e790-2330-4f57-9807-ee2e787c4abc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:27.845820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6688e790-2330-4f57-9807-ee2e787c4abc tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 0.327806 Dec 21 04:07:27.857213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 310/624] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:27 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:27.867553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ae39f9c2-e450-4649-bccb-4a17e2c4129e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:27.868383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ae39f9c2-e450-4649-bccb-4a17e2c4129e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:27.877927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae39f9c2-e450-4649-bccb-4a17e2c4129e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:27.878445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae39f9c2-e450-4649-bccb-4a17e2c4129e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:27.879342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae39f9c2-e450-4649-bccb-4a17e2c4129e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:27.879838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae39f9c2-e450-4649-bccb-4a17e2c4129e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:28.054573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ae39f9c2-e450-4649-bccb-4a17e2c4129e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:28.064388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ae39f9c2-e450-4649-bccb-4a17e2c4129e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1302 microversion: 2.1 time: 0.216239 Dec 21 04:07:28.068823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 311/625] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:27 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1302 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:28.206107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-93b50207-730e-4da2-87c4-ac0d720ff131 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:28.206887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-93b50207-730e-4da2-87c4-ac0d720ff131 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:28.215093 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93b50207-730e-4da2-87c4-ac0d720ff131 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:28.215706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93b50207-730e-4da2-87c4-ac0d720ff131 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:28.216461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93b50207-730e-4da2-87c4-ac0d720ff131 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:28.216965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93b50207-730e-4da2-87c4-ac0d720ff131 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:28.529321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-93b50207-730e-4da2-87c4-ac0d720ff131 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:28.542869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-93b50207-730e-4da2-87c4-ac0d720ff131 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1560 microversion: 2.1 time: 0.345845 Dec 21 04:07:28.553379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 312/626] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:28 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1560 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:28.556462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c06412b3-6283-4b8c-8273-977542a70ca1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:28.557207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c06412b3-6283-4b8c-8273-977542a70ca1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:28.565770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c06412b3-6283-4b8c-8273-977542a70ca1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:28.566287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c06412b3-6283-4b8c-8273-977542a70ca1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:28.567223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c06412b3-6283-4b8c-8273-977542a70ca1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:28.567749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c06412b3-6283-4b8c-8273-977542a70ca1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:28.855640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c06412b3-6283-4b8c-8273-977542a70ca1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:28.875632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c06412b3-6283-4b8c-8273-977542a70ca1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:28.880388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c06412b3-6283-4b8c-8273-977542a70ca1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:28.881728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c06412b3-6283-4b8c-8273-977542a70ca1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.336543 Dec 21 04:07:28.882318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 313/627] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:28 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:28.904267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b39c3561-385c-4b54-8bd4-6424670d9c41 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:28.904986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b39c3561-385c-4b54-8bd4-6424670d9c41 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:28.914376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b39c3561-385c-4b54-8bd4-6424670d9c41 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:28.914884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b39c3561-385c-4b54-8bd4-6424670d9c41 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:28.915790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b39c3561-385c-4b54-8bd4-6424670d9c41 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:28.916279 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b39c3561-385c-4b54-8bd4-6424670d9c41 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:29.181686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b39c3561-385c-4b54-8bd4-6424670d9c41 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:29.194366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b39c3561-385c-4b54-8bd4-6424670d9c41 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 0.310261 Dec 21 04:07:29.195152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 314/628] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:28 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:29.207511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ec988138-18f3-46b4-a66a-7c954e14574f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:29.208309 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ec988138-18f3-46b4-a66a-7c954e14574f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:29.217042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec988138-18f3-46b4-a66a-7c954e14574f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:29.217551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec988138-18f3-46b4-a66a-7c954e14574f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:29.218384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec988138-18f3-46b4-a66a-7c954e14574f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:29.218881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec988138-18f3-46b4-a66a-7c954e14574f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:29.381569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ec988138-18f3-46b4-a66a-7c954e14574f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:29.393522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ec988138-18f3-46b4-a66a-7c954e14574f tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1302 microversion: 2.1 time: 0.196621 Dec 21 04:07:29.395217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 315/629] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:29 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1302 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:29.570927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-56577e5a-051a-470a-88b0-c02f80c84d7f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:29.571625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-56577e5a-051a-470a-88b0-c02f80c84d7f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:29.593911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56577e5a-051a-470a-88b0-c02f80c84d7f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:29.594419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56577e5a-051a-470a-88b0-c02f80c84d7f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:29.595313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56577e5a-051a-470a-88b0-c02f80c84d7f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:29.595811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56577e5a-051a-470a-88b0-c02f80c84d7f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:29.836157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-56577e5a-051a-470a-88b0-c02f80c84d7f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:29.855814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-56577e5a-051a-470a-88b0-c02f80c84d7f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1560 microversion: 2.1 time: 0.298321 Dec 21 04:07:29.856648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 316/630] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:29 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1560 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:29.923723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7ed4d3c2-921a-4d77-9847-413270ca02bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:29.924447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7ed4d3c2-921a-4d77-9847-413270ca02bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:29.935840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7ed4d3c2-921a-4d77-9847-413270ca02bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:29.936559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7ed4d3c2-921a-4d77-9847-413270ca02bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:29.937544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7ed4d3c2-921a-4d77-9847-413270ca02bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:29.938264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7ed4d3c2-921a-4d77-9847-413270ca02bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:30.244439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7ed4d3c2-921a-4d77-9847-413270ca02bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:30.281494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7ed4d3c2-921a-4d77-9847-413270ca02bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:30.290961 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7ed4d3c2-921a-4d77-9847-413270ca02bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:30.303450 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7ed4d3c2-921a-4d77-9847-413270ca02bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.381982 Dec 21 04:07:30.315638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 317/631] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:29 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:30.326736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-afd7f76f-3d49-4c3b-9019-ae641b58545b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:30.326736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-afd7f76f-3d49-4c3b-9019-ae641b58545b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:30.335804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-afd7f76f-3d49-4c3b-9019-ae641b58545b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:30.336326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-afd7f76f-3d49-4c3b-9019-ae641b58545b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:30.337177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-afd7f76f-3d49-4c3b-9019-ae641b58545b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:30.337690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-afd7f76f-3d49-4c3b-9019-ae641b58545b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:30.633970 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-afd7f76f-3d49-4c3b-9019-ae641b58545b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:30.646633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-afd7f76f-3d49-4c3b-9019-ae641b58545b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 0.329583 Dec 21 04:07:30.647286 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 318/632] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:30 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:30.663760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e54bf952-dc7d-4d4d-8667-f0fe2a86dadf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:30.664435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e54bf952-dc7d-4d4d-8667-f0fe2a86dadf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:30.677663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e54bf952-dc7d-4d4d-8667-f0fe2a86dadf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:30.678295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e54bf952-dc7d-4d4d-8667-f0fe2a86dadf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:30.679401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e54bf952-dc7d-4d4d-8667-f0fe2a86dadf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:30.679965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e54bf952-dc7d-4d4d-8667-f0fe2a86dadf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:30.859504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e54bf952-dc7d-4d4d-8667-f0fe2a86dadf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:30.870623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e54bf952-dc7d-4d4d-8667-f0fe2a86dadf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1302 microversion: 2.1 time: 0.220142 Dec 21 04:07:30.871558 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 319/633] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:30 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1302 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:30.882744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a7e05c14-0405-4044-b157-2c96fbdbd28c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:30.883529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a7e05c14-0405-4044-b157-2c96fbdbd28c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:30.891596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a7e05c14-0405-4044-b157-2c96fbdbd28c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:30.892100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a7e05c14-0405-4044-b157-2c96fbdbd28c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:30.893599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a7e05c14-0405-4044-b157-2c96fbdbd28c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:30.894015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a7e05c14-0405-4044-b157-2c96fbdbd28c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:31.121220 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] validate_networks() for [('78dad1cc-329d-4b16-a292-99bbc6a23af7', None, None, None)] {{(pid=94298) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:07:31.165529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a7e05c14-0405-4044-b157-2c96fbdbd28c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:31.186464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a7e05c14-0405-4044-b157-2c96fbdbd28c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1560 microversion: 2.1 time: 0.313218 Dec 21 04:07:31.187322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 320/634] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:30 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1560 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:31.338481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c0eb6cff-bfd0-4f99-addc-65f1f2b7bee6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:31.340519 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c0eb6cff-bfd0-4f99-addc-65f1f2b7bee6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:31.354228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c0eb6cff-bfd0-4f99-addc-65f1f2b7bee6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:31.355244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c0eb6cff-bfd0-4f99-addc-65f1f2b7bee6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:31.356353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c0eb6cff-bfd0-4f99-addc-65f1f2b7bee6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:31.357099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c0eb6cff-bfd0-4f99-addc-65f1f2b7bee6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:31.718227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c0eb6cff-bfd0-4f99-addc-65f1f2b7bee6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:31.734178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c0eb6cff-bfd0-4f99-addc-65f1f2b7bee6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:31.743674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c0eb6cff-bfd0-4f99-addc-65f1f2b7bee6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:31.743674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c0eb6cff-bfd0-4f99-addc-65f1f2b7bee6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.425273 Dec 21 04:07:31.744485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 321/635] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:31 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:31.762933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-943461ca-f9b5-461a-bf29-b0d902be4906 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:31.762933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-943461ca-f9b5-461a-bf29-b0d902be4906 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:31.770311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-943461ca-f9b5-461a-bf29-b0d902be4906 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:31.770311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-943461ca-f9b5-461a-bf29-b0d902be4906 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:31.770311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-943461ca-f9b5-461a-bf29-b0d902be4906 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:31.770311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-943461ca-f9b5-461a-bf29-b0d902be4906 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:32.058493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-943461ca-f9b5-461a-bf29-b0d902be4906 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:32.059336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Flavor limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:07:32.059820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Image limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:07:32.060366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Flavor pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:07:32.061031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Image pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:07:32.061508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:07:32.070400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-943461ca-f9b5-461a-bf29-b0d902be4906 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 0.325049 Dec 21 04:07:32.080363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 322/636] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:31 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:32.081227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:32.081227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:32.081227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:32.081227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:32.084478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-41ad1e8e-6495-4f3e-860e-7c3019cc87fb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:32.085730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-41ad1e8e-6495-4f3e-860e-7c3019cc87fb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:32.094680 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41ad1e8e-6495-4f3e-860e-7c3019cc87fb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:32.095250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41ad1e8e-6495-4f3e-860e-7c3019cc87fb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:32.096126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41ad1e8e-6495-4f3e-860e-7c3019cc87fb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:32.096828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41ad1e8e-6495-4f3e-860e-7c3019cc87fb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:32.100878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Getting quotas for project c854b1b3076d4532ac6b8813b4df1ab6. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:07:32.105566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Getting quotas for user 9ae86a8c255940a8b6352ee2b9e1e8d5 and project c854b1b3076d4532ac6b8813b4df1ab6. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:07:32.118773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Going to run 1 instances... {{(pid=94298) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:07:32.121645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001914d0-f5f6-49c7-9ff1-2ea9f69caa02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:07:32.215679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-02669abd-ed82-400d-b07e-89fb48878497 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.562228 Dec 21 04:07:32.216326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 315/637] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:07:26 2020] POST /compute/v2.1/servers => generated 380 bytes in 5564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:07:32.236129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5e19a04a-148b-4950-8529-d4131ba43e5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:32.236844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5e19a04a-148b-4950-8529-d4131ba43e5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:32.247124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e19a04a-148b-4950-8529-d4131ba43e5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:32.247798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e19a04a-148b-4950-8529-d4131ba43e5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:32.248977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e19a04a-148b-4950-8529-d4131ba43e5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:32.249566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e19a04a-148b-4950-8529-d4131ba43e5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:32.254749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-41ad1e8e-6495-4f3e-860e-7c3019cc87fb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:32.266227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-41ad1e8e-6495-4f3e-860e-7c3019cc87fb tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 200 len: 1302 microversion: 2.1 time: 0.193643 Dec 21 04:07:32.267192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 323/638] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:32 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 1302 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:32.278606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8ec17dd1-da77-43ca-919f-1630856544b2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:32.279372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8ec17dd1-da77-43ca-919f-1630856544b2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:32.400399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8ec17dd1-da77-43ca-919f-1630856544b2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:32.412044 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8ec17dd1-da77-43ca-919f-1630856544b2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1259 microversion: 2.1 time: 0.143043 Dec 21 04:07:32.412909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 324/639] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:32 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:32.572478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5e19a04a-148b-4950-8529-d4131ba43e5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:32.583959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5e19a04a-148b-4950-8529-d4131ba43e5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1514 microversion: 2.1 time: 0.366521 Dec 21 04:07:32.584578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 316/640] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:32 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:32.772650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f10b0f9f-6fec-442e-8ab1-fe01b047f472 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:32.773904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f10b0f9f-6fec-442e-8ab1-fe01b047f472 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:32.784648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f10b0f9f-6fec-442e-8ab1-fe01b047f472 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:32.785208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f10b0f9f-6fec-442e-8ab1-fe01b047f472 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:32.786200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f10b0f9f-6fec-442e-8ab1-fe01b047f472 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:32.786820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f10b0f9f-6fec-442e-8ab1-fe01b047f472 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:33.073436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f10b0f9f-6fec-442e-8ab1-fe01b047f472 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:33.094323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7dfb975a-e4be-4757-b266-8174be66d489 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:33.096388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7dfb975a-e4be-4757-b266-8174be66d489 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:33.097006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f10b0f9f-6fec-442e-8ab1-fe01b047f472 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:33.105202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f10b0f9f-6fec-442e-8ab1-fe01b047f472 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:33.106837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f10b0f9f-6fec-442e-8ab1-fe01b047f472 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.346754 Dec 21 04:07:33.108124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 325/641] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:32 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:33.127977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7dfb975a-e4be-4757-b266-8174be66d489 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:33.130701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7dfb975a-e4be-4757-b266-8174be66d489 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:33.131801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7dfb975a-e4be-4757-b266-8174be66d489 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:33.133955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7dfb975a-e4be-4757-b266-8174be66d489 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:33.289238 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-45fa5736-17e9-4110-a420-0463166f65c9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:33.289909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-45fa5736-17e9-4110-a420-0463166f65c9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: f2eb7e97-5d80-4ff6-9f49-1ff46651638d] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:33.298061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-45fa5736-17e9-4110-a420-0463166f65c9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:33.298574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-45fa5736-17e9-4110-a420-0463166f65c9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:33.299778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-45fa5736-17e9-4110-a420-0463166f65c9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:33.300278 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-45fa5736-17e9-4110-a420-0463166f65c9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:33.357707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-45fa5736-17e9-4110-a420-0463166f65c9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] HTTP exception thrown: Instance f2eb7e97-5d80-4ff6-9f49-1ff46651638d could not be found. Dec 21 04:07:33.358493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-45fa5736-17e9-4110-a420-0463166f65c9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Returning 404 to user: Instance f2eb7e97-5d80-4ff6-9f49-1ff46651638d could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:07:33.359426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-45fa5736-17e9-4110-a420-0463166f65c9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d" status: 404 len: 111 microversion: 2.1 time: 0.079589 Dec 21 04:07:33.360378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 326/642] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:33 2020] GET /compute/v2.1/servers/f2eb7e97-5d80-4ff6-9f49-1ff46651638d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 21 04:07:33.436161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0618b4ef-aea4-45dd-a3ff-86f285cde0d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:33.437420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0618b4ef-aea4-45dd-a3ff-86f285cde0d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:33.446716 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0618b4ef-aea4-45dd-a3ff-86f285cde0d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:33.447560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0618b4ef-aea4-45dd-a3ff-86f285cde0d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:33.448624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0618b4ef-aea4-45dd-a3ff-86f285cde0d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:33.449442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7dfb975a-e4be-4757-b266-8174be66d489 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:33.450119 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0618b4ef-aea4-45dd-a3ff-86f285cde0d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:33.463973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7dfb975a-e4be-4757-b266-8174be66d489 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 0.378847 Dec 21 04:07:33.464684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 317/643] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:33 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:33.602626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0618b4ef-aea4-45dd-a3ff-86f285cde0d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:33.610622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3165f09b-f31e-4cf4-805a-4807acc57b20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:33.619288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0618b4ef-aea4-45dd-a3ff-86f285cde0d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1311 microversion: 2.1 time: 0.192456 Dec 21 04:07:33.620269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 327/644] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:33 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1311 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:33.627995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3165f09b-f31e-4cf4-805a-4807acc57b20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:33.645599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3165f09b-f31e-4cf4-805a-4807acc57b20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:33.647878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3165f09b-f31e-4cf4-805a-4807acc57b20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:33.649862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3165f09b-f31e-4cf4-805a-4807acc57b20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:33.650457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3165f09b-f31e-4cf4-805a-4807acc57b20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:34.135298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-535ea436-a787-492a-add6-6a9637904711 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:34.139302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-535ea436-a787-492a-add6-6a9637904711 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:34.153274 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-535ea436-a787-492a-add6-6a9637904711 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:34.154438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-535ea436-a787-492a-add6-6a9637904711 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:34.156410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-535ea436-a787-492a-add6-6a9637904711 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:34.157919 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-535ea436-a787-492a-add6-6a9637904711 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:34.445501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3165f09b-f31e-4cf4-805a-4807acc57b20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:34.469294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3165f09b-f31e-4cf4-805a-4807acc57b20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1514 microversion: 2.1 time: 0.870637 Dec 21 04:07:34.469915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 318/645] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:33 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1514 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:34.514976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7e2e5981-1b7b-45f8-a555-27694d9d50f0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:34.515773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7e2e5981-1b7b-45f8-a555-27694d9d50f0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:34.537092 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e2e5981-1b7b-45f8-a555-27694d9d50f0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:34.537726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e2e5981-1b7b-45f8-a555-27694d9d50f0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:34.538748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e2e5981-1b7b-45f8-a555-27694d9d50f0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:34.543028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e2e5981-1b7b-45f8-a555-27694d9d50f0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:34.586069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-535ea436-a787-492a-add6-6a9637904711 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:34.615392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-535ea436-a787-492a-add6-6a9637904711 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:34.624712 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-535ea436-a787-492a-add6-6a9637904711 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:34.626177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-535ea436-a787-492a-add6-6a9637904711 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.501056 Dec 21 04:07:34.640621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 328/646] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:34 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:34.653395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f401fa5c-48f1-424e-b4e5-fa1627eb5173 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:34.654338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f401fa5c-48f1-424e-b4e5-fa1627eb5173 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:34.664004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f401fa5c-48f1-424e-b4e5-fa1627eb5173 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:34.664765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f401fa5c-48f1-424e-b4e5-fa1627eb5173 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:34.665778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f401fa5c-48f1-424e-b4e5-fa1627eb5173 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:34.666426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f401fa5c-48f1-424e-b4e5-fa1627eb5173 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:34.838225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f401fa5c-48f1-424e-b4e5-fa1627eb5173 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:34.853778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f401fa5c-48f1-424e-b4e5-fa1627eb5173 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1317 microversion: 2.1 time: 0.211360 Dec 21 04:07:34.854839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 329/647] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:34 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:34.869663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7fb0e2b5-2541-44ee-a1e9-f9848462598b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:34.870658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7fb0e2b5-2541-44ee-a1e9-f9848462598b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:34.882799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7fb0e2b5-2541-44ee-a1e9-f9848462598b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:34.883765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7fb0e2b5-2541-44ee-a1e9-f9848462598b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:34.885340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7fb0e2b5-2541-44ee-a1e9-f9848462598b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:34.886190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7fb0e2b5-2541-44ee-a1e9-f9848462598b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:35.007491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7fb0e2b5-2541-44ee-a1e9-f9848462598b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Going to try to terminate instance {{(pid=94299) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:07:35.177636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7fb0e2b5-2541-44ee-a1e9-f9848462598b tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "DELETE /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 204 len: 0 microversion: 2.1 time: 0.321124 Dec 21 04:07:35.181273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 330/648] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:07:34 2020] DELETE /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:07:35.205985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bc16ec58-4355-40b5-8f9a-2a4ac3f92c57 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:35.206872 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bc16ec58-4355-40b5-8f9a-2a4ac3f92c57 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:35.236299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc16ec58-4355-40b5-8f9a-2a4ac3f92c57 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:35.237467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc16ec58-4355-40b5-8f9a-2a4ac3f92c57 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:35.238457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc16ec58-4355-40b5-8f9a-2a4ac3f92c57 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:35.239307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc16ec58-4355-40b5-8f9a-2a4ac3f92c57 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:35.846774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bc16ec58-4355-40b5-8f9a-2a4ac3f92c57 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:35.857330 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bc16ec58-4355-40b5-8f9a-2a4ac3f92c57 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1514 microversion: 2.1 time: 0.671424 Dec 21 04:07:35.858254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 331/649] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:35 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1514 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:35.883123 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-11a7cf0f-9163-4643-9c45-70736acdba4e req-8b7c86f0-2816-4b13-9d35-f87372bff6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9c955c-eab7-4008-a9e4-75837f8cc0f4", "name": "network-vif-unplugged", "status": "completed", "tag": "143f81ae-4663-43fe-a5c8-1eea68349715"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:35.900482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:35.900482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:07:35.918390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-11a7cf0f-9163-4643-9c45-70736acdba4e req-8b7c86f0-2816-4b13-9d35-f87372bff6c6 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:35.918885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-11a7cf0f-9163-4643-9c45-70736acdba4e req-8b7c86f0-2816-4b13-9d35-f87372bff6c6 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:35.950517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-11a7cf0f-9163-4643-9c45-70736acdba4e req-8b7c86f0-2816-4b13-9d35-f87372bff6c6 service nova] Creating event network-vif-unplugged:143f81ae-4663-43fe-a5c8-1eea68349715 for instance 5f9c955c-eab7-4008-a9e4-75837f8cc0f4 on hv-cinder-73306 Dec 21 04:07:35.955706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-11a7cf0f-9163-4643-9c45-70736acdba4e req-8b7c86f0-2816-4b13-9d35-f87372bff6c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096045 Dec 21 04:07:35.956349 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 332/650] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:07:35 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:07:35.969234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c5d34884-dd92-4701-94eb-d60fac7ac5ba tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:35.970074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c5d34884-dd92-4701-94eb-d60fac7ac5ba tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:35.979114 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c5d34884-dd92-4701-94eb-d60fac7ac5ba tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:35.979627 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c5d34884-dd92-4701-94eb-d60fac7ac5ba tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:35.980550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c5d34884-dd92-4701-94eb-d60fac7ac5ba tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:35.981028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c5d34884-dd92-4701-94eb-d60fac7ac5ba tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:36.279792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c5d34884-dd92-4701-94eb-d60fac7ac5ba tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:36.292310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c5d34884-dd92-4701-94eb-d60fac7ac5ba tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1514 microversion: 2.1 time: 0.332582 Dec 21 04:07:36.303888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 333/651] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:35 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1514 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:36.305183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bd80651a-f6b9-4af8-8ab9-b7bbc6a3ea63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:36.306093 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bd80651a-f6b9-4af8-8ab9-b7bbc6a3ea63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:36.316130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bd80651a-f6b9-4af8-8ab9-b7bbc6a3ea63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:36.316687 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bd80651a-f6b9-4af8-8ab9-b7bbc6a3ea63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:36.317592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bd80651a-f6b9-4af8-8ab9-b7bbc6a3ea63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:36.318134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bd80651a-f6b9-4af8-8ab9-b7bbc6a3ea63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:36.605608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7e2e5981-1b7b-45f8-a555-27694d9d50f0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:36.629692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7e2e5981-1b7b-45f8-a555-27694d9d50f0 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 2.146439 Dec 21 04:07:36.636441 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bd80651a-f6b9-4af8-8ab9-b7bbc6a3ea63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:36.655347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 319/652] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:34 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:36.657583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bd80651a-f6b9-4af8-8ab9-b7bbc6a3ea63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:36.666013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bd80651a-f6b9-4af8-8ab9-b7bbc6a3ea63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:36.667416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bd80651a-f6b9-4af8-8ab9-b7bbc6a3ea63 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.373293 Dec 21 04:07:36.668535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 334/653] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:36 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:36.670761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ad55bce3-1143-4e02-a111-2831144f06d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:36.678288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ad55bce3-1143-4e02-a111-2831144f06d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:36.692612 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ad55bce3-1143-4e02-a111-2831144f06d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:36.694399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ad55bce3-1143-4e02-a111-2831144f06d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:36.701099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ad55bce3-1143-4e02-a111-2831144f06d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:36.703625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ad55bce3-1143-4e02-a111-2831144f06d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:36.888577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e3c7654b-e848-45a9-b5d8-314197604c1a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:36.894454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e3c7654b-e848-45a9-b5d8-314197604c1a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:36.912321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3c7654b-e848-45a9-b5d8-314197604c1a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:36.920736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3c7654b-e848-45a9-b5d8-314197604c1a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:36.921882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3c7654b-e848-45a9-b5d8-314197604c1a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:36.922827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3c7654b-e848-45a9-b5d8-314197604c1a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:37.082498 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ad55bce3-1143-4e02-a111-2831144f06d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:37.120684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ad55bce3-1143-4e02-a111-2831144f06d6 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1317 microversion: 2.1 time: 0.463612 Dec 21 04:07:37.121936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 320/654] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:36 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:37.322388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-138c43aa-033d-417e-b82f-2e37a84c419c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:37.331673 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-138c43aa-033d-417e-b82f-2e37a84c419c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:37.343870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e3c7654b-e848-45a9-b5d8-314197604c1a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:37.347157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-138c43aa-033d-417e-b82f-2e37a84c419c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:37.347653 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-138c43aa-033d-417e-b82f-2e37a84c419c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:37.348741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-138c43aa-033d-417e-b82f-2e37a84c419c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:37.353100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-138c43aa-033d-417e-b82f-2e37a84c419c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:37.361234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e3c7654b-e848-45a9-b5d8-314197604c1a tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1514 microversion: 2.1 time: 0.486953 Dec 21 04:07:37.373028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 335/655] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:36 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1514 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:37.655518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-70f75a0b-eabe-480b-9c55-b4ddb259e382 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:37.656203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-70f75a0b-eabe-480b-9c55-b4ddb259e382 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:37.677903 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70f75a0b-eabe-480b-9c55-b4ddb259e382 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:37.678423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70f75a0b-eabe-480b-9c55-b4ddb259e382 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:37.679339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70f75a0b-eabe-480b-9c55-b4ddb259e382 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:37.679855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70f75a0b-eabe-480b-9c55-b4ddb259e382 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:38.143970 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-70f75a0b-eabe-480b-9c55-b4ddb259e382 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:38.154684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-70f75a0b-eabe-480b-9c55-b4ddb259e382 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 0.510100 Dec 21 04:07:38.156906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 336/656] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:37 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:38.182099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ebb5899d-5971-4f8a-981d-879e629fb08f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:38.183875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ebb5899d-5971-4f8a-981d-879e629fb08f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:38.207184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebb5899d-5971-4f8a-981d-879e629fb08f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:38.208103 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebb5899d-5971-4f8a-981d-879e629fb08f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:38.209260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebb5899d-5971-4f8a-981d-879e629fb08f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:38.210029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebb5899d-5971-4f8a-981d-879e629fb08f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:38.684736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-138c43aa-033d-417e-b82f-2e37a84c419c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:38.698245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-138c43aa-033d-417e-b82f-2e37a84c419c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1472 microversion: 2.1 time: 1.386156 Dec 21 04:07:38.710740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 321/657] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:37 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1472 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:38.728812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-e95df5e6-87a7-4083-a38a-7a54896b125e req-1e93cb32-deeb-4cf4-a316-3a4966861815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de36eb65-105b-41ce-b7fe-04a39c08724a", "name": "network-vif-unplugged", "status": "completed", "tag": "112992d5-34d2-4969-bb40-152ef22b2f72"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:38.739195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:38.739195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:07:38.751610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-e95df5e6-87a7-4083-a38a-7a54896b125e req-1e93cb32-deeb-4cf4-a316-3a4966861815 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:38.753850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-e95df5e6-87a7-4083-a38a-7a54896b125e req-1e93cb32-deeb-4cf4-a316-3a4966861815 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:38.782685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-e95df5e6-87a7-4083-a38a-7a54896b125e req-1e93cb32-deeb-4cf4-a316-3a4966861815 service nova] Creating event network-vif-unplugged:112992d5-34d2-4969-bb40-152ef22b2f72 for instance de36eb65-105b-41ce-b7fe-04a39c08724a on hv-cinder-73306 Dec 21 04:07:38.789327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-e95df5e6-87a7-4083-a38a-7a54896b125e req-1e93cb32-deeb-4cf4-a316-3a4966861815 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077014 Dec 21 04:07:38.790145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 322/658] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:07:38 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:07:38.809413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ebb5899d-5971-4f8a-981d-879e629fb08f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:38.809923 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5fb586c5-cd5d-412e-a92f-bba307f113b4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:38.810713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5fb586c5-cd5d-412e-a92f-bba307f113b4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:38.827960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5fb586c5-cd5d-412e-a92f-bba307f113b4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:38.828649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5fb586c5-cd5d-412e-a92f-bba307f113b4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:38.829844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5fb586c5-cd5d-412e-a92f-bba307f113b4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:38.831023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5fb586c5-cd5d-412e-a92f-bba307f113b4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:38.873794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ebb5899d-5971-4f8a-981d-879e629fb08f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:38.886015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ebb5899d-5971-4f8a-981d-879e629fb08f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:38.887347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ebb5899d-5971-4f8a-981d-879e629fb08f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.729352 Dec 21 04:07:38.887950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 337/659] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:38 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:38.925285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9fb1828c-e3ad-4ff1-9b04-6f95f95f135d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:38.927920 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9fb1828c-e3ad-4ff1-9b04-6f95f95f135d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:38.952437 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9fb1828c-e3ad-4ff1-9b04-6f95f95f135d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:38.953241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9fb1828c-e3ad-4ff1-9b04-6f95f95f135d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:38.954560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9fb1828c-e3ad-4ff1-9b04-6f95f95f135d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:38.955805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9fb1828c-e3ad-4ff1-9b04-6f95f95f135d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:39.176452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5fb586c5-cd5d-412e-a92f-bba307f113b4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:39.194834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5fb586c5-cd5d-412e-a92f-bba307f113b4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1317 microversion: 2.1 time: 0.402963 Dec 21 04:07:39.211698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 323/660] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:38 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:39.219411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ad17af73-d0fb-4d68-b894-3cb8d996fdf9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:39.223351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ad17af73-d0fb-4d68-b894-3cb8d996fdf9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:39.246860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ad17af73-d0fb-4d68-b894-3cb8d996fdf9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:39.247555 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ad17af73-d0fb-4d68-b894-3cb8d996fdf9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:39.248514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ad17af73-d0fb-4d68-b894-3cb8d996fdf9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:39.249118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ad17af73-d0fb-4d68-b894-3cb8d996fdf9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:39.304738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9fb1828c-e3ad-4ff1-9b04-6f95f95f135d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:39.324260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9fb1828c-e3ad-4ff1-9b04-6f95f95f135d tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1514 microversion: 2.1 time: 0.435113 Dec 21 04:07:39.324901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 338/661] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:38 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1514 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:39.726970 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-37f315bb-3c91-49c3-93e0-1680d4f966ae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:39.727643 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-37f315bb-3c91-49c3-93e0-1680d4f966ae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:39.738233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-37f315bb-3c91-49c3-93e0-1680d4f966ae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:39.739036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-37f315bb-3c91-49c3-93e0-1680d4f966ae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:39.739891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-37f315bb-3c91-49c3-93e0-1680d4f966ae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:39.740389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-37f315bb-3c91-49c3-93e0-1680d4f966ae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:39.912999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-37f315bb-3c91-49c3-93e0-1680d4f966ae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:39.926937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-37f315bb-3c91-49c3-93e0-1680d4f966ae tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1472 microversion: 2.1 time: 0.212680 Dec 21 04:07:39.938583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 339/662] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:39 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1472 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:39.955060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-64b14897-506c-4b51-b9df-0df53d8f3122 req-bb53c1a0-c5d5-4731-a39a-d64e14ebccac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9c955c-eab7-4008-a9e4-75837f8cc0f4", "name": "network-vif-deleted", "tag": "143f81ae-4663-43fe-a5c8-1eea68349715"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:39.967793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:39.967793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:07:39.979543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-64b14897-506c-4b51-b9df-0df53d8f3122 req-bb53c1a0-c5d5-4731-a39a-d64e14ebccac service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:39.980620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-64b14897-506c-4b51-b9df-0df53d8f3122 req-bb53c1a0-c5d5-4731-a39a-d64e14ebccac service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:40.006775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-64b14897-506c-4b51-b9df-0df53d8f3122 req-bb53c1a0-c5d5-4731-a39a-d64e14ebccac service nova] Creating event network-vif-deleted:143f81ae-4663-43fe-a5c8-1eea68349715 for instance 5f9c955c-eab7-4008-a9e4-75837f8cc0f4 on hv-cinder-73306 Dec 21 04:07:40.013393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-64b14897-506c-4b51-b9df-0df53d8f3122 req-bb53c1a0-c5d5-4731-a39a-d64e14ebccac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071229 Dec 21 04:07:40.014051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 340/663] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:07:39 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:07:40.028909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-54835412-a14a-43c4-908d-4aaa125d1f85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:40.030331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-54835412-a14a-43c4-908d-4aaa125d1f85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:40.040841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-54835412-a14a-43c4-908d-4aaa125d1f85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:40.041359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-54835412-a14a-43c4-908d-4aaa125d1f85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:40.042232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-54835412-a14a-43c4-908d-4aaa125d1f85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:40.042736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-54835412-a14a-43c4-908d-4aaa125d1f85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:40.340612 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-54835412-a14a-43c4-908d-4aaa125d1f85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:40.361205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-54835412-a14a-43c4-908d-4aaa125d1f85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:40.369488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-54835412-a14a-43c4-908d-4aaa125d1f85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:40.370884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-54835412-a14a-43c4-908d-4aaa125d1f85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.355540 Dec 21 04:07:40.371873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 341/664] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:40 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:40.382928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8f331fcd-5001-4aad-9b35-efe309216d43 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:40.383729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8f331fcd-5001-4aad-9b35-efe309216d43 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:40.394656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f331fcd-5001-4aad-9b35-efe309216d43 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:40.395395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f331fcd-5001-4aad-9b35-efe309216d43 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:40.396360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f331fcd-5001-4aad-9b35-efe309216d43 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:40.396866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f331fcd-5001-4aad-9b35-efe309216d43 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:40.793909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8f331fcd-5001-4aad-9b35-efe309216d43 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:40.810224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8f331fcd-5001-4aad-9b35-efe309216d43 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.437071 Dec 21 04:07:40.821604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 342/665] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:40 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:40.826622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5542e4fc-3714-4fe2-8166-b6b62e612203 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:40.827183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5542e4fc-3714-4fe2-8166-b6b62e612203 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:40.852244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5542e4fc-3714-4fe2-8166-b6b62e612203 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:40.852761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5542e4fc-3714-4fe2-8166-b6b62e612203 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:40.853628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5542e4fc-3714-4fe2-8166-b6b62e612203 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:40.854130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5542e4fc-3714-4fe2-8166-b6b62e612203 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:40.855956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ad17af73-d0fb-4d68-b894-3cb8d996fdf9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:40.895940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ad17af73-d0fb-4d68-b894-3cb8d996fdf9 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1507 microversion: 2.1 time: 1.692423 Dec 21 04:07:40.897243 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 324/666] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:39 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1507 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:40.952894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-340b5a91-8c46-4d2d-b7df-a7c6fced1d2d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:40.957061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-340b5a91-8c46-4d2d-b7df-a7c6fced1d2d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:40.979684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-340b5a91-8c46-4d2d-b7df-a7c6fced1d2d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:40.980590 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-340b5a91-8c46-4d2d-b7df-a7c6fced1d2d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:40.981650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-340b5a91-8c46-4d2d-b7df-a7c6fced1d2d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:40.982333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-340b5a91-8c46-4d2d-b7df-a7c6fced1d2d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:41.187425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-340b5a91-8c46-4d2d-b7df-a7c6fced1d2d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:41.187946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-340b5a91-8c46-4d2d-b7df-a7c6fced1d2d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:41.190592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-340b5a91-8c46-4d2d-b7df-a7c6fced1d2d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lazy-loading 'fault' on Instance uuid 5f9c955c-eab7-4008-a9e4-75837f8cc0f4 {{(pid=94298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:07:41.445311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5542e4fc-3714-4fe2-8166-b6b62e612203 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:41.467748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5542e4fc-3714-4fe2-8166-b6b62e612203 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1514 microversion: 2.1 time: 0.655325 Dec 21 04:07:41.468750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 343/667] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:40 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1514 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:41.497779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0990f8cc-b786-412f-881e-3ff715434cbf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:41.498455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0990f8cc-b786-412f-881e-3ff715434cbf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:41.526577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0990f8cc-b786-412f-881e-3ff715434cbf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:41.527127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0990f8cc-b786-412f-881e-3ff715434cbf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:41.527991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0990f8cc-b786-412f-881e-3ff715434cbf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:41.528498 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0990f8cc-b786-412f-881e-3ff715434cbf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:41.821861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-340b5a91-8c46-4d2d-b7df-a7c6fced1d2d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:41.847075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-340b5a91-8c46-4d2d-b7df-a7c6fced1d2d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 200 len: 1309 microversion: 2.1 time: 0.903636 Dec 21 04:07:41.863964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 325/668] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:40 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 1309 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:41.888610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e1e5e115-4218-4c10-a86e-f4877b1916b1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:41.889691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e1e5e115-4218-4c10-a86e-f4877b1916b1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:41.931037 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e1e5e115-4218-4c10-a86e-f4877b1916b1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:41.939292 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e1e5e115-4218-4c10-a86e-f4877b1916b1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:41.941454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e1e5e115-4218-4c10-a86e-f4877b1916b1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:41.943336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e1e5e115-4218-4c10-a86e-f4877b1916b1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:42.058406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0990f8cc-b786-412f-881e-3ff715434cbf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:42.094034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0990f8cc-b786-412f-881e-3ff715434cbf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:42.104474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0990f8cc-b786-412f-881e-3ff715434cbf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:42.116850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0990f8cc-b786-412f-881e-3ff715434cbf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.628222 Dec 21 04:07:42.117491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 344/669] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:41 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:42.155625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ee02b4eb-c753-4d12-9691-5109844bbc98 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:42.156318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ee02b4eb-c753-4d12-9691-5109844bbc98 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:42.177671 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee02b4eb-c753-4d12-9691-5109844bbc98 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:42.178634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee02b4eb-c753-4d12-9691-5109844bbc98 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:42.180316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee02b4eb-c753-4d12-9691-5109844bbc98 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:42.181411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee02b4eb-c753-4d12-9691-5109844bbc98 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:42.353543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee02b4eb-c753-4d12-9691-5109844bbc98 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:42.353973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee02b4eb-c753-4d12-9691-5109844bbc98 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:42.355151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-ee02b4eb-c753-4d12-9691-5109844bbc98 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lazy-loading 'fault' on Instance uuid de36eb65-105b-41ce-b7fe-04a39c08724a {{(pid=94299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:07:42.469501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ee02b4eb-c753-4d12-9691-5109844bbc98 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:42.493544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ee02b4eb-c753-4d12-9691-5109844bbc98 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 200 len: 1310 microversion: 2.1 time: 0.360075 Dec 21 04:07:42.506669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 345/670] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:42 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 1310 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:42.517752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a3c9b4d7-9283-47d9-afdf-cc1a63c7c9b9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:42.518509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a3c9b4d7-9283-47d9-afdf-cc1a63c7c9b9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:42.526648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a3c9b4d7-9283-47d9-afdf-cc1a63c7c9b9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:42.527273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a3c9b4d7-9283-47d9-afdf-cc1a63c7c9b9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:42.528246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a3c9b4d7-9283-47d9-afdf-cc1a63c7c9b9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:42.528744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a3c9b4d7-9283-47d9-afdf-cc1a63c7c9b9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:42.914782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a3c9b4d7-9283-47d9-afdf-cc1a63c7c9b9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:42.938735 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a3c9b4d7-9283-47d9-afdf-cc1a63c7c9b9 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1514 microversion: 2.1 time: 0.430629 Dec 21 04:07:42.939386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 346/671] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:42 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1514 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:42.959771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-0a62cf3a-3050-4066-94b9-7785de03a311 req-b6588ed4-1367-4405-b9ed-fd479342333b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de36eb65-105b-41ce-b7fe-04a39c08724a", "name": "network-vif-deleted", "tag": "112992d5-34d2-4969-bb40-152ef22b2f72"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:42.967006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:42.967006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:07:42.989910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-0a62cf3a-3050-4066-94b9-7785de03a311 req-b6588ed4-1367-4405-b9ed-fd479342333b service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:42.990426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-0a62cf3a-3050-4066-94b9-7785de03a311 req-b6588ed4-1367-4405-b9ed-fd479342333b service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:43.037694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-0a62cf3a-3050-4066-94b9-7785de03a311 req-b6588ed4-1367-4405-b9ed-fd479342333b service nova] Creating event network-vif-deleted:112992d5-34d2-4969-bb40-152ef22b2f72 for instance de36eb65-105b-41ce-b7fe-04a39c08724a on hv-cinder-73306 Dec 21 04:07:43.047675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-0a62cf3a-3050-4066-94b9-7785de03a311 req-b6588ed4-1367-4405-b9ed-fd479342333b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105799 Dec 21 04:07:43.048453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 347/672] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:07:42 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:07:43.078255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c635c099-11b2-48e2-bfa2-f7ef3ba53b2e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:43.079161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c635c099-11b2-48e2-bfa2-f7ef3ba53b2e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 5f9c955c-eab7-4008-a9e4-75837f8cc0f4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:43.094939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c635c099-11b2-48e2-bfa2-f7ef3ba53b2e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:43.094939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c635c099-11b2-48e2-bfa2-f7ef3ba53b2e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:43.094939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c635c099-11b2-48e2-bfa2-f7ef3ba53b2e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:43.100307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c635c099-11b2-48e2-bfa2-f7ef3ba53b2e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:43.228461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-c635c099-11b2-48e2-bfa2-f7ef3ba53b2e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] HTTP exception thrown: Instance 5f9c955c-eab7-4008-a9e4-75837f8cc0f4 could not be found. Dec 21 04:07:43.229165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c635c099-11b2-48e2-bfa2-f7ef3ba53b2e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Returning 404 to user: Instance 5f9c955c-eab7-4008-a9e4-75837f8cc0f4 could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:07:43.230122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c635c099-11b2-48e2-bfa2-f7ef3ba53b2e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4" status: 404 len: 111 microversion: 2.1 time: 0.180362 Dec 21 04:07:43.243318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 348/673] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:43 2020] GET /compute/v2.1/servers/5f9c955c-eab7-4008-a9e4-75837f8cc0f4 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:07:43.243318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d8a065cc-939e-4f44-b0e7-bb6ed4b905d6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:43.243318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d8a065cc-939e-4f44-b0e7-bb6ed4b905d6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:43.269992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d8a065cc-939e-4f44-b0e7-bb6ed4b905d6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:43.270517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d8a065cc-939e-4f44-b0e7-bb6ed4b905d6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:43.271453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d8a065cc-939e-4f44-b0e7-bb6ed4b905d6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:43.271959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d8a065cc-939e-4f44-b0e7-bb6ed4b905d6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:43.807887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e1e5e115-4218-4c10-a86e-f4877b1916b1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:43.809327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d8a065cc-939e-4f44-b0e7-bb6ed4b905d6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:43.831010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e1e5e115-4218-4c10-a86e-f4877b1916b1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 1.965400 Dec 21 04:07:43.847907 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 326/674] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:41 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:43.864026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d8a065cc-939e-4f44-b0e7-bb6ed4b905d6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:43.870602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-745c6aff-c73e-4470-9337-a5e7edfe7668 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:43.872979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-745c6aff-c73e-4470-9337-a5e7edfe7668 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: de36eb65-105b-41ce-b7fe-04a39c08724a] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:43.882424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d8a065cc-939e-4f44-b0e7-bb6ed4b905d6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:43.883498 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d8a065cc-939e-4f44-b0e7-bb6ed4b905d6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.651480 Dec 21 04:07:43.885574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 349/675] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:43 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:43.891121 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-745c6aff-c73e-4470-9337-a5e7edfe7668 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:43.893023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-745c6aff-c73e-4470-9337-a5e7edfe7668 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:43.894114 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-745c6aff-c73e-4470-9337-a5e7edfe7668 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:43.894741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-745c6aff-c73e-4470-9337-a5e7edfe7668 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:43.965864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b96592bd-95a6-4009-a3a3-0d65fc17034e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:43.970002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b96592bd-95a6-4009-a3a3-0d65fc17034e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:43.990429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b96592bd-95a6-4009-a3a3-0d65fc17034e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:43.990557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-745c6aff-c73e-4470-9337-a5e7edfe7668 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] HTTP exception thrown: Instance de36eb65-105b-41ce-b7fe-04a39c08724a could not be found. Dec 21 04:07:43.990644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b96592bd-95a6-4009-a3a3-0d65fc17034e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:43.991082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-745c6aff-c73e-4470-9337-a5e7edfe7668 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Returning 404 to user: Instance de36eb65-105b-41ce-b7fe-04a39c08724a could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:07:43.992285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-745c6aff-c73e-4470-9337-a5e7edfe7668 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a" status: 404 len: 111 microversion: 2.1 time: 0.142478 Dec 21 04:07:43.992778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 327/676] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:43 2020] GET /compute/v2.1/servers/de36eb65-105b-41ce-b7fe-04a39c08724a => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:07:43.996979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b96592bd-95a6-4009-a3a3-0d65fc17034e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:43.997952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b96592bd-95a6-4009-a3a3-0d65fc17034e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:44.022931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6ca66713-bce4-4f7c-b9e3-66a2b750d84b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:44.023499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6ca66713-bce4-4f7c-b9e3-66a2b750d84b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:44.046667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ca66713-bce4-4f7c-b9e3-66a2b750d84b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:44.048571 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ca66713-bce4-4f7c-b9e3-66a2b750d84b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:44.053221 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ca66713-bce4-4f7c-b9e3-66a2b750d84b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:44.054442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ca66713-bce4-4f7c-b9e3-66a2b750d84b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:44.242490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6ca66713-bce4-4f7c-b9e3-66a2b750d84b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Going to try to terminate instance {{(pid=94298) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:07:44.324784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b96592bd-95a6-4009-a3a3-0d65fc17034e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:44.336633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b96592bd-95a6-4009-a3a3-0d65fc17034e tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1514 microversion: 2.1 time: 0.382308 Dec 21 04:07:44.350439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 350/677] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:43 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1514 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:44.364613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-e408c402-f41e-4498-9197-8ecee59e4517 req-c94ccf8b-60f1-4c3e-8714-ccf69511c101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37226a3f-240e-4e04-9813-fa3d109452de", "name": "network-vif-plugged", "status": "completed", "tag": "cebf23f8-0aba-463b-89c6-d9e38a717d77"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:44.374236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:44.374236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:07:44.384265 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-e408c402-f41e-4498-9197-8ecee59e4517 req-c94ccf8b-60f1-4c3e-8714-ccf69511c101 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:44.384942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-e408c402-f41e-4498-9197-8ecee59e4517 req-c94ccf8b-60f1-4c3e-8714-ccf69511c101 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:44.406830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-e408c402-f41e-4498-9197-8ecee59e4517 req-c94ccf8b-60f1-4c3e-8714-ccf69511c101 service nova] Creating event network-vif-plugged:cebf23f8-0aba-463b-89c6-d9e38a717d77 for instance 37226a3f-240e-4e04-9813-fa3d109452de on hv-cinder-73306 Dec 21 04:07:44.415781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-e408c402-f41e-4498-9197-8ecee59e4517 req-c94ccf8b-60f1-4c3e-8714-ccf69511c101 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061775 Dec 21 04:07:44.418668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 351/678] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:07:44 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:07:44.568868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6ca66713-bce4-4f7c-b9e3-66a2b750d84b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "DELETE /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 204 len: 0 microversion: 2.1 time: 0.570826 Dec 21 04:07:44.569733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 328/679] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:07:43 2020] DELETE /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 21 04:07:44.588909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0a87ee02-ece8-46e1-bf79-f1115fad6583 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:44.589823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0a87ee02-ece8-46e1-bf79-f1115fad6583 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:44.600943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a87ee02-ece8-46e1-bf79-f1115fad6583 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:44.601675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a87ee02-ece8-46e1-bf79-f1115fad6583 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:44.602710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a87ee02-ece8-46e1-bf79-f1115fad6583 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:44.603357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a87ee02-ece8-46e1-bf79-f1115fad6583 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:44.860218 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-06e816d4-12e7-4c3c-8332-5bec7079713f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:44.861010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-06e816d4-12e7-4c3c-8332-5bec7079713f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:44.884429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-06e816d4-12e7-4c3c-8332-5bec7079713f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:44.884944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-06e816d4-12e7-4c3c-8332-5bec7079713f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:44.887494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-06e816d4-12e7-4c3c-8332-5bec7079713f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:44.889221 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-06e816d4-12e7-4c3c-8332-5bec7079713f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:44.910290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0a87ee02-ece8-46e1-bf79-f1115fad6583 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:44.929065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0a87ee02-ece8-46e1-bf79-f1115fad6583 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.354273 Dec 21 04:07:44.940726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 352/680] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:44 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:44.951934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8b477ae9-0fd8-490d-b9a0-532b35bb5810 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:44.952707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8b477ae9-0fd8-490d-b9a0-532b35bb5810 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:45.037900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8b477ae9-0fd8-490d-b9a0-532b35bb5810 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:45.038650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8b477ae9-0fd8-490d-b9a0-532b35bb5810 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:45.040995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8b477ae9-0fd8-490d-b9a0-532b35bb5810 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:45.043308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8b477ae9-0fd8-490d-b9a0-532b35bb5810 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:45.324177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8b477ae9-0fd8-490d-b9a0-532b35bb5810 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:45.346664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8b477ae9-0fd8-490d-b9a0-532b35bb5810 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:45.353924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8b477ae9-0fd8-490d-b9a0-532b35bb5810 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:45.355177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8b477ae9-0fd8-490d-b9a0-532b35bb5810 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.413301 Dec 21 04:07:45.355943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 353/681] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:44 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:45.378613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c8b673ef-26d5-4f65-a179-f64bc754c3d2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:45.378862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c8b673ef-26d5-4f65-a179-f64bc754c3d2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:45.386741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8b673ef-26d5-4f65-a179-f64bc754c3d2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:45.387290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8b673ef-26d5-4f65-a179-f64bc754c3d2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:45.388261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8b673ef-26d5-4f65-a179-f64bc754c3d2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:45.388759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8b673ef-26d5-4f65-a179-f64bc754c3d2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:45.532150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c8b673ef-26d5-4f65-a179-f64bc754c3d2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:45.541123 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c8b673ef-26d5-4f65-a179-f64bc754c3d2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1472 microversion: 2.1 time: 0.172236 Dec 21 04:07:45.541726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 354/682] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:45 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1472 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:45.952598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1f8e9de2-c933-4600-8051-a6eca117983b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:45.953153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1f8e9de2-c933-4600-8051-a6eca117983b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:45.961143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1f8e9de2-c933-4600-8051-a6eca117983b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:45.961939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1f8e9de2-c933-4600-8051-a6eca117983b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:45.962460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1f8e9de2-c933-4600-8051-a6eca117983b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:45.962972 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1f8e9de2-c933-4600-8051-a6eca117983b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:45.977669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-06e816d4-12e7-4c3c-8332-5bec7079713f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:45.987257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-06e816d4-12e7-4c3c-8332-5bec7079713f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 1.136518 Dec 21 04:07:45.988019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 329/683] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:44 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:46.037568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-4a793487-0993-4382-af4f-10117ba2ac7a req-075cfa72-f1b9-4d7f-92fe-69735df89bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa828a0-c810-48fe-8ea0-866c312aeb98", "tag": "a286529e-ec58-4881-9bf1-0a30fd25f4af"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:46.046324 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:46.046324 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:07:46.059556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-4a793487-0993-4382-af4f-10117ba2ac7a req-075cfa72-f1b9-4d7f-92fe-69735df89bd6 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:46.060170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-4a793487-0993-4382-af4f-10117ba2ac7a req-075cfa72-f1b9-4d7f-92fe-69735df89bd6 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:46.079447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-4a793487-0993-4382-af4f-10117ba2ac7a req-075cfa72-f1b9-4d7f-92fe-69735df89bd6 service nova] Creating event network-changed:a286529e-ec58-4881-9bf1-0a30fd25f4af for instance daa828a0-c810-48fe-8ea0-866c312aeb98 on hv-cinder-73306 Dec 21 04:07:46.084402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-4a793487-0993-4382-af4f-10117ba2ac7a req-075cfa72-f1b9-4d7f-92fe-69735df89bd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058317 Dec 21 04:07:46.085043 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 330/684] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:07:46 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:07:46.209213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1f8e9de2-c933-4600-8051-a6eca117983b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:46.218702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1f8e9de2-c933-4600-8051-a6eca117983b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.275340 Dec 21 04:07:46.219372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 355/685] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:45 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:46.382094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6caf47c2-a0ce-4d91-931c-bfbc942c38cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:46.382876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6caf47c2-a0ce-4d91-931c-bfbc942c38cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:46.391060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6caf47c2-a0ce-4d91-931c-bfbc942c38cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:46.391579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6caf47c2-a0ce-4d91-931c-bfbc942c38cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:46.392421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6caf47c2-a0ce-4d91-931c-bfbc942c38cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:46.393710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6caf47c2-a0ce-4d91-931c-bfbc942c38cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:46.564284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fdf02aa5-d54d-43d2-aebf-950e72f80a75 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:46.565043 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fdf02aa5-d54d-43d2-aebf-950e72f80a75 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:46.572959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fdf02aa5-d54d-43d2-aebf-950e72f80a75 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:46.573471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fdf02aa5-d54d-43d2-aebf-950e72f80a75 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:46.574308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fdf02aa5-d54d-43d2-aebf-950e72f80a75 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:46.574799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fdf02aa5-d54d-43d2-aebf-950e72f80a75 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:46.618383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6caf47c2-a0ce-4d91-931c-bfbc942c38cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:46.633231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6caf47c2-a0ce-4d91-931c-bfbc942c38cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:46.639715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6caf47c2-a0ce-4d91-931c-bfbc942c38cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:46.640912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6caf47c2-a0ce-4d91-931c-bfbc942c38cb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.269092 Dec 21 04:07:46.641498 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 331/686] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:46 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:46.707014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fdf02aa5-d54d-43d2-aebf-950e72f80a75 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:46.716026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fdf02aa5-d54d-43d2-aebf-950e72f80a75 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1472 microversion: 2.1 time: 0.160749 Dec 21 04:07:46.716567 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 356/687] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:46 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:47.010683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b119361e-4fc8-4869-89da-6c0b190452ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:47.011432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b119361e-4fc8-4869-89da-6c0b190452ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:47.019467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b119361e-4fc8-4869-89da-6c0b190452ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:47.019977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b119361e-4fc8-4869-89da-6c0b190452ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:47.020824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b119361e-4fc8-4869-89da-6c0b190452ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:47.021321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b119361e-4fc8-4869-89da-6c0b190452ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:47.244585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-951395c7-f114-4d54-8bf2-d66adf3d9d83 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:47.245255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-951395c7-f114-4d54-8bf2-d66adf3d9d83 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:47.247627 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b119361e-4fc8-4869-89da-6c0b190452ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:47.253679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-951395c7-f114-4d54-8bf2-d66adf3d9d83 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:47.254454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-951395c7-f114-4d54-8bf2-d66adf3d9d83 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:47.255472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-951395c7-f114-4d54-8bf2-d66adf3d9d83 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:47.256092 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-951395c7-f114-4d54-8bf2-d66adf3d9d83 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:47.258868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b119361e-4fc8-4869-89da-6c0b190452ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.257120 Dec 21 04:07:47.259581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 332/688] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:47 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:47.506269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-951395c7-f114-4d54-8bf2-d66adf3d9d83 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:47.517425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-951395c7-f114-4d54-8bf2-d66adf3d9d83 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.283203 Dec 21 04:07:47.519120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 357/689] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:47 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:47.666448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-406d22cd-3935-4e90-a13f-d3378de97aaf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:47.667143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-406d22cd-3935-4e90-a13f-d3378de97aaf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:47.675901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-406d22cd-3935-4e90-a13f-d3378de97aaf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:47.676337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-406d22cd-3935-4e90-a13f-d3378de97aaf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:47.677171 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-406d22cd-3935-4e90-a13f-d3378de97aaf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:47.677666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-406d22cd-3935-4e90-a13f-d3378de97aaf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:47.740244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ccf9a094-cdb7-463c-89b3-e8abac792923 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:47.751697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ccf9a094-cdb7-463c-89b3-e8abac792923 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:47.760314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ccf9a094-cdb7-463c-89b3-e8abac792923 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:47.760935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ccf9a094-cdb7-463c-89b3-e8abac792923 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:47.761926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ccf9a094-cdb7-463c-89b3-e8abac792923 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:47.762507 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ccf9a094-cdb7-463c-89b3-e8abac792923 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:47.911145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ccf9a094-cdb7-463c-89b3-e8abac792923 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:47.929234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-406d22cd-3935-4e90-a13f-d3378de97aaf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:47.931511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ccf9a094-cdb7-463c-89b3-e8abac792923 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1472 microversion: 2.1 time: 0.191074 Dec 21 04:07:47.932413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 358/690] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:47 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1472 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:47.949656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-406d22cd-3935-4e90-a13f-d3378de97aaf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:47.956857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-406d22cd-3935-4e90-a13f-d3378de97aaf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:47.958060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-406d22cd-3935-4e90-a13f-d3378de97aaf tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.301285 Dec 21 04:07:47.958639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 333/691] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:47 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:48.106825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-80f1d3ee-e41a-432c-bd34-cc24039be238 req-cb784010-28f2-4348-87cd-eb8711292804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658a086f-4f18-4fe0-a27b-c88bdf8bba38", "name": "network-vif-deleted", "tag": "c3d06276-942a-422b-add5-5fb80a8c96cc"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:48.116457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:48.116457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:07:48.129560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-80f1d3ee-e41a-432c-bd34-cc24039be238 req-cb784010-28f2-4348-87cd-eb8711292804 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:48.130280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-80f1d3ee-e41a-432c-bd34-cc24039be238 req-cb784010-28f2-4348-87cd-eb8711292804 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:48.149405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-80f1d3ee-e41a-432c-bd34-cc24039be238 req-cb784010-28f2-4348-87cd-eb8711292804 service nova] Creating event network-vif-deleted:c3d06276-942a-422b-add5-5fb80a8c96cc for instance 658a086f-4f18-4fe0-a27b-c88bdf8bba38 on hv-cinder-73306 Dec 21 04:07:48.154387 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-80f1d3ee-e41a-432c-bd34-cc24039be238 req-cb784010-28f2-4348-87cd-eb8711292804 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058600 Dec 21 04:07:48.155063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 359/692] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:07:48 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:07:48.283110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-75558460-508e-49b1-83da-c22a97976c81 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:48.283783 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-75558460-508e-49b1-83da-c22a97976c81 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:48.292000 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75558460-508e-49b1-83da-c22a97976c81 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:48.292456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75558460-508e-49b1-83da-c22a97976c81 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:48.293258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75558460-508e-49b1-83da-c22a97976c81 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:48.293743 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75558460-508e-49b1-83da-c22a97976c81 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:48.543605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ae6a310b-05f9-4455-9900-5b4cfa199f3b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:48.544475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ae6a310b-05f9-4455-9900-5b4cfa199f3b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:48.545052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-75558460-508e-49b1-83da-c22a97976c81 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:48.556528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae6a310b-05f9-4455-9900-5b4cfa199f3b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:48.557170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae6a310b-05f9-4455-9900-5b4cfa199f3b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:48.558115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae6a310b-05f9-4455-9900-5b4cfa199f3b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:48.558811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae6a310b-05f9-4455-9900-5b4cfa199f3b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:48.566251 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-75558460-508e-49b1-83da-c22a97976c81 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.292195 Dec 21 04:07:48.567063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 334/693] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:48 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:48.830661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ae6a310b-05f9-4455-9900-5b4cfa199f3b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:48.842263 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ae6a310b-05f9-4455-9900-5b4cfa199f3b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.309212 Dec 21 04:07:48.842956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 360/694] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:48 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:48.954756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-278c10cd-fe79-4422-80b8-764bccdd02b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:48.967901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-278c10cd-fe79-4422-80b8-764bccdd02b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:48.976807 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-278c10cd-fe79-4422-80b8-764bccdd02b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:48.977321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-278c10cd-fe79-4422-80b8-764bccdd02b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:48.978181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-278c10cd-fe79-4422-80b8-764bccdd02b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:48.978676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-278c10cd-fe79-4422-80b8-764bccdd02b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:48.987517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2c37d803-f9ee-4f55-a4e9-f02545caeb04 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:48.989327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2c37d803-f9ee-4f55-a4e9-f02545caeb04 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:49.010813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2c37d803-f9ee-4f55-a4e9-f02545caeb04 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:49.011763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2c37d803-f9ee-4f55-a4e9-f02545caeb04 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:49.012829 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2c37d803-f9ee-4f55-a4e9-f02545caeb04 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:49.013513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2c37d803-f9ee-4f55-a4e9-f02545caeb04 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:49.171585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-278c10cd-fe79-4422-80b8-764bccdd02b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:49.186753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-278c10cd-fe79-4422-80b8-764bccdd02b2 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1472 microversion: 2.1 time: 0.241060 Dec 21 04:07:49.188003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 335/695] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:48 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1472 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:49.499769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2c37d803-f9ee-4f55-a4e9-f02545caeb04 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:49.522732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2c37d803-f9ee-4f55-a4e9-f02545caeb04 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:49.535895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2c37d803-f9ee-4f55-a4e9-f02545caeb04 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:49.537130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2c37d803-f9ee-4f55-a4e9-f02545caeb04 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.563143 Dec 21 04:07:49.537706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 361/696] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:48 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:07:49.590058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-eabaff98-4e69-43c3-ac63-2f7ea5c9f9b0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:49.590863 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-eabaff98-4e69-43c3-ac63-2f7ea5c9f9b0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:49.600232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eabaff98-4e69-43c3-ac63-2f7ea5c9f9b0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:49.600842 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eabaff98-4e69-43c3-ac63-2f7ea5c9f9b0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:49.601766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eabaff98-4e69-43c3-ac63-2f7ea5c9f9b0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:49.602343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eabaff98-4e69-43c3-ac63-2f7ea5c9f9b0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:49.856084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-eabaff98-4e69-43c3-ac63-2f7ea5c9f9b0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:49.869650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-eabaff98-4e69-43c3-ac63-2f7ea5c9f9b0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.289037 Dec 21 04:07:49.870854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 336/697] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:49 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:49.884428 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6f8ec9b5-dc7d-4dce-a703-be9086bd2733 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:49.885363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6f8ec9b5-dc7d-4dce-a703-be9086bd2733 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:49.894816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f8ec9b5-dc7d-4dce-a703-be9086bd2733 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:49.895458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f8ec9b5-dc7d-4dce-a703-be9086bd2733 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:49.896394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f8ec9b5-dc7d-4dce-a703-be9086bd2733 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:49.896971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f8ec9b5-dc7d-4dce-a703-be9086bd2733 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:50.147603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6f8ec9b5-dc7d-4dce-a703-be9086bd2733 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:50.159389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6f8ec9b5-dc7d-4dce-a703-be9086bd2733 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.302238 Dec 21 04:07:50.160100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 362/698] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:49 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:50.211529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fd3f5a35-e7ff-4196-90fb-8ec9e08d9ae8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:50.212169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fd3f5a35-e7ff-4196-90fb-8ec9e08d9ae8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:50.220096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fd3f5a35-e7ff-4196-90fb-8ec9e08d9ae8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:50.220629 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fd3f5a35-e7ff-4196-90fb-8ec9e08d9ae8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:50.221525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fd3f5a35-e7ff-4196-90fb-8ec9e08d9ae8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:50.221989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fd3f5a35-e7ff-4196-90fb-8ec9e08d9ae8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:50.358371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fd3f5a35-e7ff-4196-90fb-8ec9e08d9ae8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:50.368219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fd3f5a35-e7ff-4196-90fb-8ec9e08d9ae8 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1472 microversion: 2.1 time: 0.166019 Dec 21 04:07:50.368800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 337/699] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:50 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:50.563950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-26f56254-210c-4f0c-9cd1-872ec61679f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:50.564664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-26f56254-210c-4f0c-9cd1-872ec61679f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:50.572777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26f56254-210c-4f0c-9cd1-872ec61679f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:50.573283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26f56254-210c-4f0c-9cd1-872ec61679f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:50.574124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26f56254-210c-4f0c-9cd1-872ec61679f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:50.574615 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26f56254-210c-4f0c-9cd1-872ec61679f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:50.797110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-26f56254-210c-4f0c-9cd1-872ec61679f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:50.815910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-26f56254-210c-4f0c-9cd1-872ec61679f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:50.819931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-26f56254-210c-4f0c-9cd1-872ec61679f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:50.821180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-26f56254-210c-4f0c-9cd1-872ec61679f1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.266438 Dec 21 04:07:50.828223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 363/700] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:50 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:50.894603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1150c2f4-6f08-4668-b14b-9b9081491e0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:50.895401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1150c2f4-6f08-4668-b14b-9b9081491e0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:50.903343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1150c2f4-6f08-4668-b14b-9b9081491e0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:50.903933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1150c2f4-6f08-4668-b14b-9b9081491e0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:50.904845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1150c2f4-6f08-4668-b14b-9b9081491e0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:50.905410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1150c2f4-6f08-4668-b14b-9b9081491e0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:51.157967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1150c2f4-6f08-4668-b14b-9b9081491e0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:51.166775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1150c2f4-6f08-4668-b14b-9b9081491e0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.281905 Dec 21 04:07:51.167711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 338/701] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:50 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:51.185414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c7296093-56e5-4d4d-b1c1-1489be3d22a4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:51.186094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c7296093-56e5-4d4d-b1c1-1489be3d22a4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:51.199067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7296093-56e5-4d4d-b1c1-1489be3d22a4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:51.199581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7296093-56e5-4d4d-b1c1-1489be3d22a4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:51.200423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7296093-56e5-4d4d-b1c1-1489be3d22a4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:51.200925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7296093-56e5-4d4d-b1c1-1489be3d22a4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:51.394696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a9a44adf-1d01-41e0-91c8-a74d9045d506 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:51.395527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a9a44adf-1d01-41e0-91c8-a74d9045d506 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:51.406353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a9a44adf-1d01-41e0-91c8-a74d9045d506 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:51.407379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a9a44adf-1d01-41e0-91c8-a74d9045d506 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:51.409123 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a9a44adf-1d01-41e0-91c8-a74d9045d506 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:51.409744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a9a44adf-1d01-41e0-91c8-a74d9045d506 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:51.576595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a9a44adf-1d01-41e0-91c8-a74d9045d506 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:51.586579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a9a44adf-1d01-41e0-91c8-a74d9045d506 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1472 microversion: 2.1 time: 0.204634 Dec 21 04:07:51.587768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 339/702] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:51 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1472 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:51.671218 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c7296093-56e5-4d4d-b1c1-1489be3d22a4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:51.681932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c7296093-56e5-4d4d-b1c1-1489be3d22a4 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.505566 Dec 21 04:07:51.682520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 364/703] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:51 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:51.848761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-506903a0-158c-494a-a532-7119ba91720a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:51.849454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-506903a0-158c-494a-a532-7119ba91720a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:51.857569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-506903a0-158c-494a-a532-7119ba91720a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:51.858085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-506903a0-158c-494a-a532-7119ba91720a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:51.858958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-506903a0-158c-494a-a532-7119ba91720a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:51.859458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-506903a0-158c-494a-a532-7119ba91720a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:52.193144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-af3ee13a-fb48-4ea7-aaf5-8c32a1cff622 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:52.194124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-af3ee13a-fb48-4ea7-aaf5-8c32a1cff622 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:52.206642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af3ee13a-fb48-4ea7-aaf5-8c32a1cff622 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:52.207323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af3ee13a-fb48-4ea7-aaf5-8c32a1cff622 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:52.208170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af3ee13a-fb48-4ea7-aaf5-8c32a1cff622 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:52.208657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-af3ee13a-fb48-4ea7-aaf5-8c32a1cff622 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:52.421429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-506903a0-158c-494a-a532-7119ba91720a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:52.437891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-506903a0-158c-494a-a532-7119ba91720a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:52.458169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-506903a0-158c-494a-a532-7119ba91720a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:52.462278 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-af3ee13a-fb48-4ea7-aaf5-8c32a1cff622 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:52.465640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-506903a0-158c-494a-a532-7119ba91720a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.628328 Dec 21 04:07:52.466248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 340/704] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:51 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:52.482450 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-af3ee13a-fb48-4ea7-aaf5-8c32a1cff622 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.300874 Dec 21 04:07:52.483529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 365/705] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:52 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:52.610978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-87e9ac09-13d8-4992-a2e2-70d25fc966cf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:52.612126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-87e9ac09-13d8-4992-a2e2-70d25fc966cf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:52.620737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87e9ac09-13d8-4992-a2e2-70d25fc966cf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:52.621248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87e9ac09-13d8-4992-a2e2-70d25fc966cf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:52.622120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87e9ac09-13d8-4992-a2e2-70d25fc966cf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:52.622628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87e9ac09-13d8-4992-a2e2-70d25fc966cf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:52.706075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bab4de2d-fdd5-4df9-b22b-f595146ae15e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:52.706788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bab4de2d-fdd5-4df9-b22b-f595146ae15e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:52.715480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bab4de2d-fdd5-4df9-b22b-f595146ae15e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:52.715984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bab4de2d-fdd5-4df9-b22b-f595146ae15e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:52.716849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bab4de2d-fdd5-4df9-b22b-f595146ae15e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:52.717336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bab4de2d-fdd5-4df9-b22b-f595146ae15e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:52.931335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-87e9ac09-13d8-4992-a2e2-70d25fc966cf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52adbfb830ce4351a1eca89f2e4392bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5c999358804f80929d210c54fe1fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:52.940886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-87e9ac09-13d8-4992-a2e2-70d25fc966cf tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 200 len: 1472 microversion: 2.1 time: 0.339165 Dec 21 04:07:52.941161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bab4de2d-fdd5-4df9-b22b-f595146ae15e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:52.941448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 341/706] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:52 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 1472 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:52.950121 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bab4de2d-fdd5-4df9-b22b-f595146ae15e tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.253749 Dec 21 04:07:52.950696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 366/707] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:52 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:07:53.285269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1227241933", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "networks": [{"uuid": "0cb38372-b1fe-404c-9646-e5579ec8fe7b"}]}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:53.365594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] validate_networks() for [('0cb38372-b1fe-404c-9646-e5579ec8fe7b', None, None, None)] {{(pid=94298) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:07:53.492139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0081dd8a-a6bb-4f94-94dd-52cce057f076 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:53.493337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0081dd8a-a6bb-4f94-94dd-52cce057f076 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:53.502492 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0081dd8a-a6bb-4f94-94dd-52cce057f076 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:53.503458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0081dd8a-a6bb-4f94-94dd-52cce057f076 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:53.504478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0081dd8a-a6bb-4f94-94dd-52cce057f076 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:53.505126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0081dd8a-a6bb-4f94-94dd-52cce057f076 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:53.755935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0081dd8a-a6bb-4f94-94dd-52cce057f076 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:53.771932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0081dd8a-a6bb-4f94-94dd-52cce057f076 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:53.779337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0081dd8a-a6bb-4f94-94dd-52cce057f076 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:53.780773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0081dd8a-a6bb-4f94-94dd-52cce057f076 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.299747 Dec 21 04:07:53.781574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 367/708] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:53 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:53.792504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3ee950f1-ed9d-4281-a70c-a23838b97ee4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:53.793384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3ee950f1-ed9d-4281-a70c-a23838b97ee4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:53.803264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ee950f1-ed9d-4281-a70c-a23838b97ee4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:53.803894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ee950f1-ed9d-4281-a70c-a23838b97ee4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:53.804796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ee950f1-ed9d-4281-a70c-a23838b97ee4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:53.805325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ee950f1-ed9d-4281-a70c-a23838b97ee4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:54.110290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3ee950f1-ed9d-4281-a70c-a23838b97ee4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:54.122075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3ee950f1-ed9d-4281-a70c-a23838b97ee4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.339078 Dec 21 04:07:54.122865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 368/709] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:53 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:54.133819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fff8d603-26db-410d-bbfc-cc561b46e696 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:54.134483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fff8d603-26db-410d-bbfc-cc561b46e696 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] [instance: 658a086f-4f18-4fe0-a27b-c88bdf8bba38] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:54.143242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fff8d603-26db-410d-bbfc-cc561b46e696 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:54.143707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fff8d603-26db-410d-bbfc-cc561b46e696 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:54.144547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fff8d603-26db-410d-bbfc-cc561b46e696 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:54.145041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fff8d603-26db-410d-bbfc-cc561b46e696 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:54.202036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-fff8d603-26db-410d-bbfc-cc561b46e696 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] HTTP exception thrown: Instance 658a086f-4f18-4fe0-a27b-c88bdf8bba38 could not be found. Dec 21 04:07:54.202612 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fff8d603-26db-410d-bbfc-cc561b46e696 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] Returning 404 to user: Instance 658a086f-4f18-4fe0-a27b-c88bdf8bba38 could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:07:54.203706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fff8d603-26db-410d-bbfc-cc561b46e696 tempest-AttachVolumeNegativeTest-190670502 tempest-AttachVolumeNegativeTest-190670502] 10.222.0.16 "GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38" status: 404 len: 111 microversion: 2.1 time: 0.079999 Dec 21 04:07:54.204522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 369/710] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:54 2020] GET /compute/v2.1/servers/658a086f-4f18-4fe0-a27b-c88bdf8bba38 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:07:54.219397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5ee54e63-b39e-4711-acb3-38854b1caf45 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:54.221235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5ee54e63-b39e-4711-acb3-38854b1caf45 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:54.231947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5ee54e63-b39e-4711-acb3-38854b1caf45 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:54.232951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5ee54e63-b39e-4711-acb3-38854b1caf45 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:54.234051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5ee54e63-b39e-4711-acb3-38854b1caf45 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:54.234755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5ee54e63-b39e-4711-acb3-38854b1caf45 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:54.818515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5ee54e63-b39e-4711-acb3-38854b1caf45 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:54.827612 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5ee54e63-b39e-4711-acb3-38854b1caf45 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.619232 Dec 21 04:07:54.840071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 370/711] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:54 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:54.840071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4f7e0244-b236-415d-bae3-c68bb1766617 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:54.840329 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4f7e0244-b236-415d-bae3-c68bb1766617 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:54.850414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f7e0244-b236-415d-bae3-c68bb1766617 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:54.851498 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f7e0244-b236-415d-bae3-c68bb1766617 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:54.853104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f7e0244-b236-415d-bae3-c68bb1766617 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:54.853725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f7e0244-b236-415d-bae3-c68bb1766617 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:55.023878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Flavor limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:07:55.024351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Image limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:07:55.024989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Flavor pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:07:55.025447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Image pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:07:55.025903 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:07:55.035463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:55.035905 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:55.036765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:55.037305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:55.057563 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Getting quotas for project 13fc3096c5c34fe8b975ecce478f85fc. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:07:55.061945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Getting quotas for user 6f4617f0566845acb67b02c72c97856b and project 13fc3096c5c34fe8b975ecce478f85fc. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:07:55.073764 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Going to run 1 instances... {{(pid=94298) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:07:55.076414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:07:55.117517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4f7e0244-b236-415d-bae3-c68bb1766617 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:55.129526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c5aea49f-31ef-48a5-960e-1082ee008d6d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.854441 Dec 21 04:07:55.130726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 342/712] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:07:53 2020] POST /compute/v2.1/servers => generated 380 bytes in 1856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:07:55.139495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4f7e0244-b236-415d-bae3-c68bb1766617 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:55.146178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4f7e0244-b236-415d-bae3-c68bb1766617 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:55.147480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4f7e0244-b236-415d-bae3-c68bb1766617 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.318286 Dec 21 04:07:55.148304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 371/713] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:54 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:55.148930 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8a05e034-945c-4ca3-ab11-c47acc629b04 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:55.150294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8a05e034-945c-4ca3-ab11-c47acc629b04 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:55.166306 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0ebe5e85-0dc5-4df6-8dc2-1bb96ac1a593 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:55.167109 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0ebe5e85-0dc5-4df6-8dc2-1bb96ac1a593 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:55.177300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ebe5e85-0dc5-4df6-8dc2-1bb96ac1a593 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:55.177913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ebe5e85-0dc5-4df6-8dc2-1bb96ac1a593 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:55.178858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ebe5e85-0dc5-4df6-8dc2-1bb96ac1a593 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:55.179495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ebe5e85-0dc5-4df6-8dc2-1bb96ac1a593 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:55.344340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8a05e034-945c-4ca3-ab11-c47acc629b04 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:55.354947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8a05e034-945c-4ca3-ab11-c47acc629b04 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1219 microversion: 2.1 time: 0.217694 Dec 21 04:07:55.356245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 343/714] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:55 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1219 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:55.425901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0ebe5e85-0dc5-4df6-8dc2-1bb96ac1a593 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:55.435338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0ebe5e85-0dc5-4df6-8dc2-1bb96ac1a593 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.278859 Dec 21 04:07:55.447084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 372/715] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:55 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:55.851477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3c284f2e-4832-46e7-a682-613dde3d893b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:55.852068 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3c284f2e-4832-46e7-a682-613dde3d893b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:55.860073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c284f2e-4832-46e7-a682-613dde3d893b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:55.860591 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c284f2e-4832-46e7-a682-613dde3d893b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:55.861592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c284f2e-4832-46e7-a682-613dde3d893b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:55.862089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c284f2e-4832-46e7-a682-613dde3d893b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:56.173955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-838dc431-79be-4f3e-b541-86104c8a0f61 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:56.174631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-838dc431-79be-4f3e-b541-86104c8a0f61 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:56.183056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-838dc431-79be-4f3e-b541-86104c8a0f61 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:56.183566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-838dc431-79be-4f3e-b541-86104c8a0f61 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:56.184410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-838dc431-79be-4f3e-b541-86104c8a0f61 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:56.184899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-838dc431-79be-4f3e-b541-86104c8a0f61 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:56.427607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-838dc431-79be-4f3e-b541-86104c8a0f61 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:56.444823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-838dc431-79be-4f3e-b541-86104c8a0f61 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:56.451619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-838dc431-79be-4f3e-b541-86104c8a0f61 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:56.455308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-838dc431-79be-4f3e-b541-86104c8a0f61 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1809 microversion: 2.20 time: 0.290907 Dec 21 04:07:56.467626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 373/716] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:56 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1809 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:56.479031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-da4b377f-69c9-427d-9526-38ef6a46e3ff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:56.479712 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-da4b377f-69c9-427d-9526-38ef6a46e3ff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:56.489937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-da4b377f-69c9-427d-9526-38ef6a46e3ff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:56.492017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-da4b377f-69c9-427d-9526-38ef6a46e3ff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:56.492990 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-da4b377f-69c9-427d-9526-38ef6a46e3ff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:56.493378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-da4b377f-69c9-427d-9526-38ef6a46e3ff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:56.637830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-da4b377f-69c9-427d-9526-38ef6a46e3ff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:56.648018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-da4b377f-69c9-427d-9526-38ef6a46e3ff tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1271 microversion: 2.1 time: 0.179185 Dec 21 04:07:56.648621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 374/717] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:56 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:56.659619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f017af89-c30c-434d-9a9d-a342487b643c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:56.660299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f017af89-c30c-434d-9a9d-a342487b643c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:56.668682 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f017af89-c30c-434d-9a9d-a342487b643c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:56.669200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f017af89-c30c-434d-9a9d-a342487b643c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:56.670050 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f017af89-c30c-434d-9a9d-a342487b643c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:56.670548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f017af89-c30c-434d-9a9d-a342487b643c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:56.790150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3c284f2e-4832-46e7-a682-613dde3d893b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:56.808928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3c284f2e-4832-46e7-a682-613dde3d893b tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.966909 Dec 21 04:07:56.809535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 344/718] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:55 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:56.936880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f017af89-c30c-434d-9a9d-a342487b643c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:56.947133 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f017af89-c30c-434d-9a9d-a342487b643c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.297181 Dec 21 04:07:56.957620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 375/719] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:56 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:57.484681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c8521baf-bdcb-4ca6-814b-911c0f1552cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:57.485386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c8521baf-bdcb-4ca6-814b-911c0f1552cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:57.505477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8521baf-bdcb-4ca6-814b-911c0f1552cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:57.506400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8521baf-bdcb-4ca6-814b-911c0f1552cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:57.507464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8521baf-bdcb-4ca6-814b-911c0f1552cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:57.507464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8521baf-bdcb-4ca6-814b-911c0f1552cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:57.676397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-09a045df-03a6-4221-89ee-f3b9a9e6e174 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:57.677131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-09a045df-03a6-4221-89ee-f3b9a9e6e174 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:57.685634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09a045df-03a6-4221-89ee-f3b9a9e6e174 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:57.686138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09a045df-03a6-4221-89ee-f3b9a9e6e174 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:57.686993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09a045df-03a6-4221-89ee-f3b9a9e6e174 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:57.687483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09a045df-03a6-4221-89ee-f3b9a9e6e174 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:57.831059 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-09a045df-03a6-4221-89ee-f3b9a9e6e174 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:57.840554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-09a045df-03a6-4221-89ee-f3b9a9e6e174 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1277 microversion: 2.1 time: 0.178579 Dec 21 04:07:57.842586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 376/720] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:57 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:57.852445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0e7798e5-4e4f-4615-b11e-27fb13fb2868 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:57.853248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0e7798e5-4e4f-4615-b11e-27fb13fb2868 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:57.862079 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0e7798e5-4e4f-4615-b11e-27fb13fb2868 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:57.862580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0e7798e5-4e4f-4615-b11e-27fb13fb2868 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:57.863441 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0e7798e5-4e4f-4615-b11e-27fb13fb2868 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:57.864195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0e7798e5-4e4f-4615-b11e-27fb13fb2868 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:57.980117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c8521baf-bdcb-4ca6-814b-911c0f1552cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:57.999677 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c8521baf-bdcb-4ca6-814b-911c0f1552cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:58.007610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c8521baf-bdcb-4ca6-814b-911c0f1552cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:58.009304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c8521baf-bdcb-4ca6-814b-911c0f1552cd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1796 microversion: 2.20 time: 0.539012 Dec 21 04:07:58.010318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 345/721] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:07:57 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1796 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:07:58.031949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f12411af-e60d-4be9-94f9-f69098020c88 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:58.032751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f12411af-e60d-4be9-94f9-f69098020c88 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:58.051134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f12411af-e60d-4be9-94f9-f69098020c88 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:58.057009 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f12411af-e60d-4be9-94f9-f69098020c88 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:58.057913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f12411af-e60d-4be9-94f9-f69098020c88 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:58.058416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f12411af-e60d-4be9-94f9-f69098020c88 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:58.133768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0e7798e5-4e4f-4615-b11e-27fb13fb2868 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:58.145396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0e7798e5-4e4f-4615-b11e-27fb13fb2868 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.303120 Dec 21 04:07:58.146306 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 377/722] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:57 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:58.360609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f12411af-e60d-4be9-94f9-f69098020c88 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:58.370651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f12411af-e60d-4be9-94f9-f69098020c88 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.359038 Dec 21 04:07:58.371547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 346/723] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:58 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:58.762094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-499a1eb9-d65a-464c-8f0f-d6a212df5659 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Action: 'create', calling method: .version_select at 0x7f2bb9a56840>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1855322221"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:07:58.865681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ed058ff1-1db6-4c67-92e2-5dfbcf4de05a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:58.866467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ed058ff1-1db6-4c67-92e2-5dfbcf4de05a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:58.874601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed058ff1-1db6-4c67-92e2-5dfbcf4de05a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:58.875232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed058ff1-1db6-4c67-92e2-5dfbcf4de05a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:58.876240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed058ff1-1db6-4c67-92e2-5dfbcf4de05a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:58.876741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed058ff1-1db6-4c67-92e2-5dfbcf4de05a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:59.352723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ed058ff1-1db6-4c67-92e2-5dfbcf4de05a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:59.362022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ed058ff1-1db6-4c67-92e2-5dfbcf4de05a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1319 microversion: 2.1 time: 0.506947 Dec 21 04:07:59.362618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 347/724] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:58 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1319 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:07:59.368497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-499a1eb9-d65a-464c-8f0f-d6a212df5659 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.805023 Dec 21 04:07:59.369182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 378/725] 10.222.0.16 () {60 vars in 1145 bytes} [Mon Dec 21 04:07:58 2020] POST /compute/v2.1/os-volumes => generated 345 bytes in 806 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 21 04:07:59.383337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-da6fa3de-fb46-4559-a06b-0e1353ef8756 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:59.383993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-da6fa3de-fb46-4559-a06b-0e1353ef8756 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:59.385841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-80666ed5-99ce-4982-9a11-c2cab2eb00d1 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb84a0400>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:59.393206 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-da6fa3de-fb46-4559-a06b-0e1353ef8756 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:59.393811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-da6fa3de-fb46-4559-a06b-0e1353ef8756 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:59.394658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-da6fa3de-fb46-4559-a06b-0e1353ef8756 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:59.395195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-da6fa3de-fb46-4559-a06b-0e1353ef8756 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:59.533820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-80666ed5-99ce-4982-9a11-c2cab2eb00d1 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4" status: 200 len: 345 microversion: 2.1 time: 0.155922 Dec 21 04:07:59.534429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 379/726] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:07:59 2020] GET /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4 => generated 345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:07:59.550223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-08275b7a-9a94-468e-a621-3c544b83cf03 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:07:59.550917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-08275b7a-9a94-468e-a621-3c544b83cf03 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:07:59.559145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-08275b7a-9a94-468e-a621-3c544b83cf03 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:59.559660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-08275b7a-9a94-468e-a621-3c544b83cf03 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:59.560506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-08275b7a-9a94-468e-a621-3c544b83cf03 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:07:59.560997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-08275b7a-9a94-468e-a621-3c544b83cf03 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:07:59.789021 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-08275b7a-9a94-468e-a621-3c544b83cf03 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:07:59.801747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-08275b7a-9a94-468e-a621-3c544b83cf03 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.261208 Dec 21 04:07:59.802790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 380/727] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:59 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:00.096606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-da6fa3de-fb46-4559-a06b-0e1353ef8756 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:00.105436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-da6fa3de-fb46-4559-a06b-0e1353ef8756 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.741384 Dec 21 04:08:00.106023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 348/728] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:07:59 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:00.390752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5eb6a1a7-cda1-49bb-b580-8195d6abb0f6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:00.398153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-834c8d38-e1b3-49b9-937e-8ccc2cfa5d74 req-b002eaab-93e4-4c42-8bca-2af6092389ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa828a0-c810-48fe-8ea0-866c312aeb98", "name": "network-vif-plugged", "status": "completed", "tag": "a286529e-ec58-4881-9bf1-0a30fd25f4af"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:08:00.405012 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:00.405012 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:08:00.407630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5eb6a1a7-cda1-49bb-b580-8195d6abb0f6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:00.415728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5eb6a1a7-cda1-49bb-b580-8195d6abb0f6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:00.416233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5eb6a1a7-cda1-49bb-b580-8195d6abb0f6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:00.417079 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5eb6a1a7-cda1-49bb-b580-8195d6abb0f6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:00.417575 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5eb6a1a7-cda1-49bb-b580-8195d6abb0f6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:00.430080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-834c8d38-e1b3-49b9-937e-8ccc2cfa5d74 req-b002eaab-93e4-4c42-8bca-2af6092389ef service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:00.430587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-834c8d38-e1b3-49b9-937e-8ccc2cfa5d74 req-b002eaab-93e4-4c42-8bca-2af6092389ef service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:00.497582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-834c8d38-e1b3-49b9-937e-8ccc2cfa5d74 req-b002eaab-93e4-4c42-8bca-2af6092389ef service nova] Creating event network-vif-plugged:a286529e-ec58-4881-9bf1-0a30fd25f4af for instance daa828a0-c810-48fe-8ea0-866c312aeb98 on hv-cinder-73306 Dec 21 04:08:00.505022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-834c8d38-e1b3-49b9-937e-8ccc2cfa5d74 req-b002eaab-93e4-4c42-8bca-2af6092389ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126640 Dec 21 04:08:00.506565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 349/729] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:08:00 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:00.561255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cbec09b6-498c-4da7-a7c9-5a1ba8b4d5e3 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb8fea9d8>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:00.697888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5eb6a1a7-cda1-49bb-b580-8195d6abb0f6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:00.707271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5eb6a1a7-cda1-49bb-b580-8195d6abb0f6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1319 microversion: 2.1 time: 0.325673 Dec 21 04:08:00.707763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cbec09b6-498c-4da7-a7c9-5a1ba8b4d5e3 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4" status: 200 len: 346 microversion: 2.1 time: 0.159005 Dec 21 04:08:00.708621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 350/730] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:08:00 2020] GET /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4 => generated 346 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:00.719023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-3399ceb0-aea6-4001-81ff-4195ea049310 req-8492d03c-c158-43a6-aa86-7488dc6784bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63061bb7-38e7-4c2a-ac1d-eb8752fa584e", "tag": "a4d70010-d5c7-45a0-a55b-d30d1f2df8be"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:08:00.719742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 381/731] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:00 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:00.726423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:00.726423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:08:00.730870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cee676b4-50db-48cc-ac22-5ced8c7d1e36 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Action: 'create', calling method: .version_select at 0x7f2bb84ef8c8>, body: {"snapshot": {"volume_id": "905747c5-e642-4921-b09c-38811a5a61b4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-374908734"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:08:00.737161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-3399ceb0-aea6-4001-81ff-4195ea049310 req-8492d03c-c158-43a6-aa86-7488dc6784bc service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:00.737662 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-3399ceb0-aea6-4001-81ff-4195ea049310 req-8492d03c-c158-43a6-aa86-7488dc6784bc service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:00.755958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-3399ceb0-aea6-4001-81ff-4195ea049310 req-8492d03c-c158-43a6-aa86-7488dc6784bc service nova] Creating event network-changed:a4d70010-d5c7-45a0-a55b-d30d1f2df8be for instance 63061bb7-38e7-4c2a-ac1d-eb8752fa584e on hv-cinder-73306 Dec 21 04:08:00.760817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-3399ceb0-aea6-4001-81ff-4195ea049310 req-8492d03c-c158-43a6-aa86-7488dc6784bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051083 Dec 21 04:08:00.761605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 351/732] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:08:00 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:00.827174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b40fdefa-1035-48f1-8700-f01ac06183ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:00.828048 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b40fdefa-1035-48f1-8700-f01ac06183ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:00.836775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b40fdefa-1035-48f1-8700-f01ac06183ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:00.837389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b40fdefa-1035-48f1-8700-f01ac06183ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:00.838302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b40fdefa-1035-48f1-8700-f01ac06183ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:00.838858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b40fdefa-1035-48f1-8700-f01ac06183ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:00.981720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cee676b4-50db-48cc-ac22-5ced8c7d1e36 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.260455 Dec 21 04:08:00.987518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 382/733] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Dec 21 04:08:00 2020] POST /compute/v2.1/os-snapshots => generated 286 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:01.005280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ebe7bc5c-5012-4ac9-9a5e-feacbbd54597 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb8509730>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:01.058801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ebe7bc5c-5012-4ac9-9a5e-feacbbd54597 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2" status: 200 len: 286 microversion: 2.1 time: 0.064667 Dec 21 04:08:01.059505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 383/734] 10.222.0.16 () {58 vars in 1241 bytes} [Mon Dec 21 04:08:00 2020] GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:01.074782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a17584d8-c78c-47cf-b999-f6645644e5a4 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb84a0950>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:01.124423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a17584d8-c78c-47cf-b999-f6645644e5a4 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.058494 Dec 21 04:08:01.125137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 384/735] 10.222.0.16 () {58 vars in 1130 bytes} [Mon Dec 21 04:08:01 2020] GET /compute/v2.1/os-snapshots => generated 289 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:08:01.140413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-efc2fc59-2a11-4f1a-9ed0-1b994bb3c13f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:01.141086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-efc2fc59-2a11-4f1a-9ed0-1b994bb3c13f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:01.149143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efc2fc59-2a11-4f1a-9ed0-1b994bb3c13f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:01.149650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efc2fc59-2a11-4f1a-9ed0-1b994bb3c13f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:01.150478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efc2fc59-2a11-4f1a-9ed0-1b994bb3c13f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:01.150998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efc2fc59-2a11-4f1a-9ed0-1b994bb3c13f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:01.374411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-efc2fc59-2a11-4f1a-9ed0-1b994bb3c13f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:01.383542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-efc2fc59-2a11-4f1a-9ed0-1b994bb3c13f tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1522 microversion: 2.1 time: 0.251947 Dec 21 04:08:01.384140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 385/736] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:01 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:01.394547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-93636287-7454-4d38-957b-3c123a6aacc4 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb8509840>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:01.456111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-93636287-7454-4d38-957b-3c123a6aacc4 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2" status: 200 len: 286 microversion: 2.1 time: 0.070805 Dec 21 04:08:01.459275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 386/737] 10.222.0.16 () {58 vars in 1241 bytes} [Mon Dec 21 04:08:01 2020] GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:01.468299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b40fdefa-1035-48f1-8700-f01ac06183ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:01.478307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b40fdefa-1035-48f1-8700-f01ac06183ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.661050 Dec 21 04:08:01.479025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 352/738] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:00 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:01.736607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-256fb5f9-7d0a-4dde-8009-92acaa1453af tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:01.737282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-256fb5f9-7d0a-4dde-8009-92acaa1453af tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:01.746033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-256fb5f9-7d0a-4dde-8009-92acaa1453af tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:01.746540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-256fb5f9-7d0a-4dde-8009-92acaa1453af tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:01.747399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-256fb5f9-7d0a-4dde-8009-92acaa1453af tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:01.747891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-256fb5f9-7d0a-4dde-8009-92acaa1453af tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:01.964329 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-256fb5f9-7d0a-4dde-8009-92acaa1453af tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:01.973235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-256fb5f9-7d0a-4dde-8009-92acaa1453af tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1319 microversion: 2.1 time: 0.245667 Dec 21 04:08:01.973829 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 387/739] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:01 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:02.406959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3cf801a0-a15c-48fb-925c-9cd26dcab925 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:02.407624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3cf801a0-a15c-48fb-925c-9cd26dcab925 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:02.415515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3cf801a0-a15c-48fb-925c-9cd26dcab925 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:02.416017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3cf801a0-a15c-48fb-925c-9cd26dcab925 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:02.416839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3cf801a0-a15c-48fb-925c-9cd26dcab925 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:02.417331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3cf801a0-a15c-48fb-925c-9cd26dcab925 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:02.474686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4a77fda5-e444-43ca-908b-e08c6246ed62 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb8509158>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:02.529713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4a77fda5-e444-43ca-908b-e08c6246ed62 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2" status: 200 len: 286 microversion: 2.1 time: 0.064965 Dec 21 04:08:02.530339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 388/740] 10.222.0.16 () {58 vars in 1241 bytes} [Mon Dec 21 04:08:02 2020] GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:08:02.541582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e6e0372c-1133-4232-903c-b94a348cad3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:02.542307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e6e0372c-1133-4232-903c-b94a348cad3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:02.551239 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6e0372c-1133-4232-903c-b94a348cad3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:02.551757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6e0372c-1133-4232-903c-b94a348cad3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:02.552767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6e0372c-1133-4232-903c-b94a348cad3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:02.553268 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6e0372c-1133-4232-903c-b94a348cad3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:02.571783 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3cf801a0-a15c-48fb-925c-9cd26dcab925 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:02.582051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3cf801a0-a15c-48fb-925c-9cd26dcab925 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1480 microversion: 2.1 time: 0.183977 Dec 21 04:08:02.582662 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 353/741] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:02 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1480 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:02.770466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e6e0372c-1133-4232-903c-b94a348cad3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:02.779240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e6e0372c-1133-4232-903c-b94a348cad3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.247855 Dec 21 04:08:02.779845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 389/742] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:02 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:02.813033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-a44612ea-7d74-48f7-bf93-66761854bd99 req-6fa4e495-f9b1-41ec-aebd-9aa95eec3acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066ef53e-6421-4004-bd12-2e238a638cd1", "name": "network-vif-deleted", "tag": "3f4c4622-8f1b-42c5-bfc5-c5e155218d89"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:08:02.820126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:02.820126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:08:02.828835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-a44612ea-7d74-48f7-bf93-66761854bd99 req-6fa4e495-f9b1-41ec-aebd-9aa95eec3acb service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:02.829327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-a44612ea-7d74-48f7-bf93-66761854bd99 req-6fa4e495-f9b1-41ec-aebd-9aa95eec3acb service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:02.846151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-a44612ea-7d74-48f7-bf93-66761854bd99 req-6fa4e495-f9b1-41ec-aebd-9aa95eec3acb service nova] Creating event network-vif-deleted:3f4c4622-8f1b-42c5-bfc5-c5e155218d89 for instance 066ef53e-6421-4004-bd12-2e238a638cd1 on hv-cinder-73306 Dec 21 04:08:02.851235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-a44612ea-7d74-48f7-bf93-66761854bd99 req-6fa4e495-f9b1-41ec-aebd-9aa95eec3acb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047431 Dec 21 04:08:02.851847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 354/743] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:08:02 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:02.997140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6bd79f83-668c-40bc-8d61-1eeab044c3e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:02.997807 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6bd79f83-668c-40bc-8d61-1eeab044c3e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:03.006678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6bd79f83-668c-40bc-8d61-1eeab044c3e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:03.007217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6bd79f83-668c-40bc-8d61-1eeab044c3e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:03.008046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6bd79f83-668c-40bc-8d61-1eeab044c3e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:03.008541 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6bd79f83-668c-40bc-8d61-1eeab044c3e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:03.222618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6bd79f83-668c-40bc-8d61-1eeab044c3e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:03.231470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6bd79f83-668c-40bc-8d61-1eeab044c3e2 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1319 microversion: 2.1 time: 0.243608 Dec 21 04:08:03.232062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 390/744] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:02 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:03.549791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d936fde7-8a22-4293-9611-8b9b5fa58b33 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb8fea598>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:03.601438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d936fde7-8a22-4293-9611-8b9b5fa58b33 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2" status: 200 len: 286 microversion: 2.1 time: 0.062014 Dec 21 04:08:03.602060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 355/745] 10.222.0.16 () {58 vars in 1241 bytes} [Mon Dec 21 04:08:03 2020] GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:03.605750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dff64aef-51fb-4304-88a0-b8400c6a3945 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:03.606419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dff64aef-51fb-4304-88a0-b8400c6a3945 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:03.614531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dff64aef-51fb-4304-88a0-b8400c6a3945 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:03.615059 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dff64aef-51fb-4304-88a0-b8400c6a3945 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:03.615886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dff64aef-51fb-4304-88a0-b8400c6a3945 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:03.616371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dff64aef-51fb-4304-88a0-b8400c6a3945 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:03.747319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dff64aef-51fb-4304-88a0-b8400c6a3945 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9969a42d296a4ca0af35e1af6e473f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835bff285f30412e8cdd0e7f8f00f705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:03.756445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dff64aef-51fb-4304-88a0-b8400c6a3945 tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 200 len: 1480 microversion: 2.1 time: 0.159871 Dec 21 04:08:03.757041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 391/746] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:03 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 1480 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:03.802517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c0a7f7e6-9f96-4f18-98f7-867a15dbdaf0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:03.803343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c0a7f7e6-9f96-4f18-98f7-867a15dbdaf0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:03.811626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c0a7f7e6-9f96-4f18-98f7-867a15dbdaf0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:03.812139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c0a7f7e6-9f96-4f18-98f7-867a15dbdaf0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:03.812971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c0a7f7e6-9f96-4f18-98f7-867a15dbdaf0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:03.813469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c0a7f7e6-9f96-4f18-98f7-867a15dbdaf0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:04.031668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c0a7f7e6-9f96-4f18-98f7-867a15dbdaf0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:04.040974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c0a7f7e6-9f96-4f18-98f7-867a15dbdaf0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.247922 Dec 21 04:08:04.041566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 356/747] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:03 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:04.256586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ac24eabf-77e4-48d8-b655-f7b18461c1fb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:04.257481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ac24eabf-77e4-48d8-b655-f7b18461c1fb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:04.265649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ac24eabf-77e4-48d8-b655-f7b18461c1fb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:04.266299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ac24eabf-77e4-48d8-b655-f7b18461c1fb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:04.267752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ac24eabf-77e4-48d8-b655-f7b18461c1fb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:04.268394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ac24eabf-77e4-48d8-b655-f7b18461c1fb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:04.493634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ac24eabf-77e4-48d8-b655-f7b18461c1fb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:04.502810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ac24eabf-77e4-48d8-b655-f7b18461c1fb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1319 microversion: 2.1 time: 0.256624 Dec 21 04:08:04.503463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 392/748] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:04 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:04.620355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c77de1c6-0595-4133-a9e5-79e54f7d398e tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb8451d08>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:04.672810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c77de1c6-0595-4133-a9e5-79e54f7d398e tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2" status: 200 len: 287 microversion: 2.1 time: 0.062910 Dec 21 04:08:04.674117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 357/749] 10.222.0.16 () {58 vars in 1241 bytes} [Mon Dec 21 04:08:04 2020] GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:04.692592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a4289f1b-32f5-4471-bf4b-369e3785180d tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb8509378>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:04.778980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fbe5f53e-5568-4400-bc4b-9f1238a8f5ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:04.779995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fbe5f53e-5568-4400-bc4b-9f1238a8f5ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] [instance: 066ef53e-6421-4004-bd12-2e238a638cd1] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:04.789860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbe5f53e-5568-4400-bc4b-9f1238a8f5ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:04.790731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbe5f53e-5568-4400-bc4b-9f1238a8f5ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:04.791802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbe5f53e-5568-4400-bc4b-9f1238a8f5ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:04.792501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbe5f53e-5568-4400-bc4b-9f1238a8f5ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:04.810839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a4289f1b-32f5-4471-bf4b-369e3785180d tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2" status: 202 len: 0 microversion: 2.1 time: 0.129481 Dec 21 04:08:04.811675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 393/750] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Dec 21 04:08:04 2020] DELETE /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:08:04.825737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5afd633a-bba4-4924-b4eb-611dd04a7a4f tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb85090d0>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:04.847959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-fbe5f53e-5568-4400-bc4b-9f1238a8f5ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] HTTP exception thrown: Instance 066ef53e-6421-4004-bd12-2e238a638cd1 could not be found. Dec 21 04:08:04.848632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fbe5f53e-5568-4400-bc4b-9f1238a8f5ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] Returning 404 to user: Instance 066ef53e-6421-4004-bd12-2e238a638cd1 could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:08:04.849523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fbe5f53e-5568-4400-bc4b-9f1238a8f5ef tempest-ServerRescueNegativeTestJSON-155147960 tempest-ServerRescueNegativeTestJSON-155147960] 10.222.0.16 "GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1" status: 404 len: 111 microversion: 2.1 time: 0.079739 Dec 21 04:08:04.850271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 358/751] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:04 2020] GET /compute/v2.1/servers/066ef53e-6421-4004-bd12-2e238a638cd1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:08:04.890237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5afd633a-bba4-4924-b4eb-611dd04a7a4f tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2" status: 200 len: 286 microversion: 2.1 time: 0.074114 Dec 21 04:08:04.890930 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 394/752] 10.222.0.16 () {58 vars in 1241 bytes} [Mon Dec 21 04:08:04 2020] GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:08:05.064924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2ba4df1f-7387-4e8e-ae53-891cb450dec9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:05.065845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2ba4df1f-7387-4e8e-ae53-891cb450dec9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:05.076660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ba4df1f-7387-4e8e-ae53-891cb450dec9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:05.080369 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ba4df1f-7387-4e8e-ae53-891cb450dec9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:05.081243 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ba4df1f-7387-4e8e-ae53-891cb450dec9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:05.081859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ba4df1f-7387-4e8e-ae53-891cb450dec9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:05.527253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8d788732-3729-4e29-b40c-b23939e07a2a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:05.527876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8d788732-3729-4e29-b40c-b23939e07a2a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:05.538126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d788732-3729-4e29-b40c-b23939e07a2a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:05.538733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d788732-3729-4e29-b40c-b23939e07a2a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:05.539861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d788732-3729-4e29-b40c-b23939e07a2a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:05.540431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d788732-3729-4e29-b40c-b23939e07a2a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:05.672533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2ba4df1f-7387-4e8e-ae53-891cb450dec9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:05.682009 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2ba4df1f-7387-4e8e-ae53-891cb450dec9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1359 microversion: 2.1 time: 0.626898 Dec 21 04:08:05.683143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 359/753] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:05 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1359 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:05.908931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d9849d97-944d-4370-b831-34d19e14598a tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb8744d08>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:05.955446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-d9849d97-944d-4370-b831-34d19e14598a tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] HTTP exception thrown: Snapshot 08347f67-2cd0-411b-8b5d-b3f6ea430aa2 could not be found. Dec 21 04:08:05.956300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d9849d97-944d-4370-b831-34d19e14598a tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Returning 404 to user: Snapshot 08347f67-2cd0-411b-8b5d-b3f6ea430aa2 could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:08:05.957237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d9849d97-944d-4370-b831-34d19e14598a tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2" status: 404 len: 111 microversion: 2.1 time: 0.057944 Dec 21 04:08:05.957874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 360/754] 10.222.0.16 () {58 vars in 1241 bytes} [Mon Dec 21 04:08:05 2020] GET /compute/v2.1/os-snapshots/08347f67-2cd0-411b-8b5d-b3f6ea430aa2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 21 04:08:05.971903 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0e1f6286-ad5d-41da-a26c-44f465dff883 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb84510d0>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:06.002228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8d788732-3729-4e29-b40c-b23939e07a2a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:06.011167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8d788732-3729-4e29-b40c-b23939e07a2a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1319 microversion: 2.1 time: 0.494055 Dec 21 04:08:06.011985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 395/755] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:05 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:06.072137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0e1f6286-ad5d-41da-a26c-44f465dff883 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4" status: 202 len: 0 microversion: 2.1 time: 0.109342 Dec 21 04:08:06.073056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 361/756] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Dec 21 04:08:05 2020] DELETE /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 21 04:08:06.087357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f909b2b4-48aa-4246-b2ab-b94305462131 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb85099d8>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:06.166260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9822e770-5493-4969-9b87-586e9a913941 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:06.166667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9822e770-5493-4969-9b87-586e9a913941 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:06.175182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9822e770-5493-4969-9b87-586e9a913941 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:06.175692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9822e770-5493-4969-9b87-586e9a913941 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:06.176536 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9822e770-5493-4969-9b87-586e9a913941 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:06.177025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9822e770-5493-4969-9b87-586e9a913941 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:06.190464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f909b2b4-48aa-4246-b2ab-b94305462131 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4" status: 200 len: 345 microversion: 2.1 time: 0.112953 Dec 21 04:08:06.191255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 396/757] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:08:06 2020] GET /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4 => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:06.445438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9822e770-5493-4969-9b87-586e9a913941 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "DELETE /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/os-volume_attachments/72c41131-0fb2-4aa0-8a3c-92a6f3ff9512" status: 202 len: 0 microversion: 2.1 time: 0.288776 Dec 21 04:08:06.446382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 362/758] 10.222.0.16 () {58 vars in 1406 bytes} [Mon Dec 21 04:08:06 2020] DELETE /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/os-volume_attachments/72c41131-0fb2-4aa0-8a3c-92a6f3ff9512 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:08:06.706484 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2eba3444-7f8a-482e-92da-8d7d4e740946 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:06.707175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2eba3444-7f8a-482e-92da-8d7d4e740946 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:06.715869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2eba3444-7f8a-482e-92da-8d7d4e740946 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:06.716374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2eba3444-7f8a-482e-92da-8d7d4e740946 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:06.717204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2eba3444-7f8a-482e-92da-8d7d4e740946 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:06.717695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2eba3444-7f8a-482e-92da-8d7d4e740946 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:07.035635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2d074ebf-749b-424f-85d6-eb7190d4de35 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:07.036646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2d074ebf-749b-424f-85d6-eb7190d4de35 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:07.046273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d074ebf-749b-424f-85d6-eb7190d4de35 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:07.057994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d074ebf-749b-424f-85d6-eb7190d4de35 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:07.059227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d074ebf-749b-424f-85d6-eb7190d4de35 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:07.059690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d074ebf-749b-424f-85d6-eb7190d4de35 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:07.226313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2eba3444-7f8a-482e-92da-8d7d4e740946 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:07.238240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2eba3444-7f8a-482e-92da-8d7d4e740946 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1550 microversion: 2.1 time: 0.541050 Dec 21 04:08:07.239593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 397/759] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:06 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1550 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:07.251568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2c82beca-46fd-46cc-acd7-37dfd4d7cf02 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bbd27b0d0>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:07.302561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2d074ebf-749b-424f-85d6-eb7190d4de35 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:07.312426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2d074ebf-749b-424f-85d6-eb7190d4de35 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1319 microversion: 2.1 time: 0.286714 Dec 21 04:08:07.313041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 363/760] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:07 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:07.323768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0a97e8e0-3805-4f14-8b2a-ef5c5b659361 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:07.324432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0a97e8e0-3805-4f14-8b2a-ef5c5b659361 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:07.332987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a97e8e0-3805-4f14-8b2a-ef5c5b659361 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:07.333497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a97e8e0-3805-4f14-8b2a-ef5c5b659361 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:07.334346 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a97e8e0-3805-4f14-8b2a-ef5c5b659361 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:07.335511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a97e8e0-3805-4f14-8b2a-ef5c5b659361 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:07.343870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-2c82beca-46fd-46cc-acd7-37dfd4d7cf02 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] HTTP exception thrown: Volume 905747c5-e642-4921-b09c-38811a5a61b4 could not be found. Dec 21 04:08:07.344236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2c82beca-46fd-46cc-acd7-37dfd4d7cf02 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Returning 404 to user: Volume 905747c5-e642-4921-b09c-38811a5a61b4 could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:08:07.345216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2c82beca-46fd-46cc-acd7-37dfd4d7cf02 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4" status: 404 len: 109 microversion: 2.1 time: 0.104096 Dec 21 04:08:07.346438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 398/761] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:08:07 2020] GET /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:08:07.361624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-d29f444d-a060-4678-83f2-a87efaff8e74 req-f09a8e27-a3c3-443e-82d3-a89ae4d7680f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63061bb7-38e7-4c2a-ac1d-eb8752fa584e", "name": "network-vif-plugged", "status": "completed", "tag": "a4d70010-d5c7-45a0-a55b-d30d1f2df8be"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:08:07.369511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:07.369511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:08:07.381303 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-d29f444d-a060-4678-83f2-a87efaff8e74 req-f09a8e27-a3c3-443e-82d3-a89ae4d7680f service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:07.382003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-d29f444d-a060-4678-83f2-a87efaff8e74 req-f09a8e27-a3c3-443e-82d3-a89ae4d7680f service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:07.424223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-d29f444d-a060-4678-83f2-a87efaff8e74 req-f09a8e27-a3c3-443e-82d3-a89ae4d7680f service nova] Creating event network-vif-plugged:a4d70010-d5c7-45a0-a55b-d30d1f2df8be for instance 63061bb7-38e7-4c2a-ac1d-eb8752fa584e on hv-cinder-73306 Dec 21 04:08:07.431410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-d29f444d-a060-4678-83f2-a87efaff8e74 req-f09a8e27-a3c3-443e-82d3-a89ae4d7680f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083511 Dec 21 04:08:07.432226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 399/762] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:08:07 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:07.446028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5a67f072-b299-492f-80f4-af4b042fe065 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bbd27bea0>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:07.546928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-5a67f072-b299-492f-80f4-af4b042fe065 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] HTTP exception thrown: Volume 905747c5-e642-4921-b09c-38811a5a61b4 could not be found. Dec 21 04:08:07.547618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5a67f072-b299-492f-80f4-af4b042fe065 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Returning 404 to user: Volume 905747c5-e642-4921-b09c-38811a5a61b4 could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:08:07.548584 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5a67f072-b299-492f-80f4-af4b042fe065 tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4" status: 404 len: 109 microversion: 2.1 time: 0.113128 Dec 21 04:08:07.549300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 400/763] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Dec 21 04:08:07 2020] DELETE /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:08:07.563068 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0e60b69a-c1fb-4d0d-a22f-856539b3552e tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Calling method '.version_select at 0x7f2bb84a0598>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:07.647463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-0e60b69a-c1fb-4d0d-a22f-856539b3552e tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] HTTP exception thrown: Volume 905747c5-e642-4921-b09c-38811a5a61b4 could not be found. Dec 21 04:08:07.648141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0e60b69a-c1fb-4d0d-a22f-856539b3552e tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] Returning 404 to user: Volume 905747c5-e642-4921-b09c-38811a5a61b4 could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:08:07.649044 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0e60b69a-c1fb-4d0d-a22f-856539b3552e tempest-VolumesSnapshotsTestJSON-1561703429 tempest-VolumesSnapshotsTestJSON-1561703429] 10.222.0.16 "GET /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4" status: 404 len: 109 microversion: 2.1 time: 0.095381 Dec 21 04:08:07.649772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 401/764] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:08:07 2020] GET /compute/v2.1/os-volumes/905747c5-e642-4921-b09c-38811a5a61b4 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 21 04:08:07.674990 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0a97e8e0-3805-4f14-8b2a-ef5c5b659361 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:07.685776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0a97e8e0-3805-4f14-8b2a-ef5c5b659361 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1550 microversion: 2.1 time: 0.371655 Dec 21 04:08:07.686637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 364/765] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:07 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1550 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:07.709783 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0fb87491-7168-47e2-8aba-8397df1fb117 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:07.710342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a50fe822-74a3-4278-b847-7340c0984c59 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:08:07.727538 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a50fe822-74a3-4278-b847-7340c0984c59 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:07.728725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a50fe822-74a3-4278-b847-7340c0984c59 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:07.738333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:07.738333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:08:07.740060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0fb87491-7168-47e2-8aba-8397df1fb117 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:07.740900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0fb87491-7168-47e2-8aba-8397df1fb117 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Searching by: {'deleted': False, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6'} {{(pid=94298) get_all /opt/stack/nova/nova/compute/api.py:2829}} Dec 21 04:08:07.747135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0fb87491-7168-47e2-8aba-8397df1fb117 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:07.747867 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0fb87491-7168-47e2-8aba-8397df1fb117 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:07.748914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0fb87491-7168-47e2-8aba-8397df1fb117 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:07.749618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0fb87491-7168-47e2-8aba-8397df1fb117 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:07.840796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a50fe822-74a3-4278-b847-7340c0984c59 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Going to try to stop instance {{(pid=94299) force_stop /opt/stack/nova/nova/compute/api.py:2576}} Dec 21 04:08:07.855460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.multi_cell_list [None req-0fb87491-7168-47e2-8aba-8397df1fb117 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=94298) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Dec 21 04:08:07.968203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a50fe822-74a3-4278-b847-7340c0984c59 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 202 len: 0 microversion: 2.1 time: 0.261262 Dec 21 04:08:07.969965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 402/766] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:08:07 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:08:07.970603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0fb87491-7168-47e2-8aba-8397df1fb117 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.268063 Dec 21 04:08:07.980485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 365/767] 10.222.0.16 () {58 vars in 1115 bytes} [Mon Dec 21 04:08:07 2020] GET /compute/v2.1/servers => generated 343 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:07.993565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7a49bca5-a98c-40f7-876a-19718f433c3b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:07.996091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7a49bca5-a98c-40f7-876a-19718f433c3b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:07.997946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1fb11619-5f9a-4c53-9c20-d9a503e36d2f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:07.998628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1fb11619-5f9a-4c53-9c20-d9a503e36d2f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:08.007528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a49bca5-a98c-40f7-876a-19718f433c3b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:08.008226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a49bca5-a98c-40f7-876a-19718f433c3b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:08.009226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a49bca5-a98c-40f7-876a-19718f433c3b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:08.010002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a49bca5-a98c-40f7-876a-19718f433c3b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:08.010773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1fb11619-5f9a-4c53-9c20-d9a503e36d2f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:08.011313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1fb11619-5f9a-4c53-9c20-d9a503e36d2f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:08.012843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1fb11619-5f9a-4c53-9c20-d9a503e36d2f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:08.013346 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1fb11619-5f9a-4c53-9c20-d9a503e36d2f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:08.240717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1fb11619-5f9a-4c53-9c20-d9a503e36d2f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:08.250955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1fb11619-5f9a-4c53-9c20-d9a503e36d2f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1550 microversion: 2.1 time: 0.261621 Dec 21 04:08:08.251808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 366/768] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:07 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1550 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:08.338761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-051484a2-4309-4e97-826d-77f32f893083 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:08.339872 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-051484a2-4309-4e97-826d-77f32f893083 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:08.350737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-051484a2-4309-4e97-826d-77f32f893083 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:08.351364 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-051484a2-4309-4e97-826d-77f32f893083 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:08.352313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-051484a2-4309-4e97-826d-77f32f893083 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:08.353153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-051484a2-4309-4e97-826d-77f32f893083 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:08.440494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7a49bca5-a98c-40f7-876a-19718f433c3b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:08.449869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7a49bca5-a98c-40f7-876a-19718f433c3b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1680 microversion: 2.1 time: 0.473886 Dec 21 04:08:08.451017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 403/769] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:07 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1680 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:08.834654 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-051484a2-4309-4e97-826d-77f32f893083 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:08.847196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-051484a2-4309-4e97-826d-77f32f893083 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1319 microversion: 2.1 time: 0.520960 Dec 21 04:08:08.857135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 367/770] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:08 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1319 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:09.480313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5dd60c6c-78c6-42ef-959e-c65db45539ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:09.484914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5dd60c6c-78c6-42ef-959e-c65db45539ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:09.500889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5dd60c6c-78c6-42ef-959e-c65db45539ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:09.506813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5dd60c6c-78c6-42ef-959e-c65db45539ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:09.509014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5dd60c6c-78c6-42ef-959e-c65db45539ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:09.509527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5dd60c6c-78c6-42ef-959e-c65db45539ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:09.879673 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b2bece9a-20e6-4da7-8d37-a67f3555fcca tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:09.879673 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b2bece9a-20e6-4da7-8d37-a67f3555fcca tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:09.887832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b2bece9a-20e6-4da7-8d37-a67f3555fcca tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:09.888653 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b2bece9a-20e6-4da7-8d37-a67f3555fcca tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:09.889718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b2bece9a-20e6-4da7-8d37-a67f3555fcca tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:09.890517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b2bece9a-20e6-4da7-8d37-a67f3555fcca tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:09.923185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5dd60c6c-78c6-42ef-959e-c65db45539ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:09.944927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5dd60c6c-78c6-42ef-959e-c65db45539ed tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1680 microversion: 2.1 time: 0.480385 Dec 21 04:08:09.945529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 404/771] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:09 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1680 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:10.169349 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b2bece9a-20e6-4da7-8d37-a67f3555fcca tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:10.180290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b2bece9a-20e6-4da7-8d37-a67f3555fcca tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1508 microversion: 2.1 time: 0.318538 Dec 21 04:08:10.193328 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 368/772] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:09 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1508 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:08:10.209906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-adfa5d1d-717d-408d-bf2b-6b39da20bcd1 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b65963f-29b3-413e-a7b5-0b29b016b00b", "device": "/dev/sdb"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:08:10.214398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-adfa5d1d-717d-408d-bf2b-6b39da20bcd1 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:10.223537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-adfa5d1d-717d-408d-bf2b-6b39da20bcd1 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:10.223986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-adfa5d1d-717d-408d-bf2b-6b39da20bcd1 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:10.224843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-adfa5d1d-717d-408d-bf2b-6b39da20bcd1 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:10.225342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-adfa5d1d-717d-408d-bf2b-6b39da20bcd1 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:10.367175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-09f527e2-a454-4944-abc6-51b6a2443917 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e143391-15c7-44a4-a604-43b10f13945e"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:08:10.368807 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-09f527e2-a454-4944-abc6-51b6a2443917 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:10.378758 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09f527e2-a454-4944-abc6-51b6a2443917 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:10.379413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09f527e2-a454-4944-abc6-51b6a2443917 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:10.380390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09f527e2-a454-4944-abc6-51b6a2443917 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:10.381060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09f527e2-a454-4944-abc6-51b6a2443917 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:10.806386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-adfa5d1d-717d-408d-bf2b-6b39da20bcd1 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "POST /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.611351 Dec 21 04:08:10.807338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 405/773] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Dec 21 04:08:10 2020] POST /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e/os-volume_attachments => generated 194 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:10.976403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6e8f6378-fca5-4fe8-9545-578066689cc5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:10.987141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6e8f6378-fca5-4fe8-9545-578066689cc5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:11.026440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6e8f6378-fca5-4fe8-9545-578066689cc5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:11.031683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6e8f6378-fca5-4fe8-9545-578066689cc5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:11.032809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6e8f6378-fca5-4fe8-9545-578066689cc5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:11.034487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6e8f6378-fca5-4fe8-9545-578066689cc5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:11.161962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-09f527e2-a454-4944-abc6-51b6a2443917 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "POST /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805744 Dec 21 04:08:11.163620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 369/774] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Dec 21 04:08:10 2020] POST /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/os-volume_attachments => generated 194 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:11.577224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6e8f6378-fca5-4fe8-9545-578066689cc5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:11.589433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6e8f6378-fca5-4fe8-9545-578066689cc5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1680 microversion: 2.1 time: 0.628949 Dec 21 04:08:11.590358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 406/775] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:10 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1680 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:12.613458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f2a83b1e-9fdd-4816-b198-2f5871cc3573 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:12.614477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f2a83b1e-9fdd-4816-b198-2f5871cc3573 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:12.624082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2a83b1e-9fdd-4816-b198-2f5871cc3573 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:12.624606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2a83b1e-9fdd-4816-b198-2f5871cc3573 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:12.625478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2a83b1e-9fdd-4816-b198-2f5871cc3573 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:12.625973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2a83b1e-9fdd-4816-b198-2f5871cc3573 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:12.883360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f2a83b1e-9fdd-4816-b198-2f5871cc3573 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:12.892455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f2a83b1e-9fdd-4816-b198-2f5871cc3573 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1680 microversion: 2.1 time: 0.288691 Dec 21 04:08:12.893055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 370/776] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:12 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1680 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:13.915944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9300fdbf-fe3e-4525-88f4-bc425d316561 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:13.916624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9300fdbf-fe3e-4525-88f4-bc425d316561 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:13.926748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9300fdbf-fe3e-4525-88f4-bc425d316561 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:13.927285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9300fdbf-fe3e-4525-88f4-bc425d316561 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:13.928124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9300fdbf-fe3e-4525-88f4-bc425d316561 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:13.928615 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9300fdbf-fe3e-4525-88f4-bc425d316561 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:14.149989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9300fdbf-fe3e-4525-88f4-bc425d316561 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:14.159603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9300fdbf-fe3e-4525-88f4-bc425d316561 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1680 microversion: 2.1 time: 0.253710 Dec 21 04:08:14.160202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 407/777] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:13 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1680 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:14.215494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-128fdab3-3ea2-42ab-9276-f427ae25103a tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] Action: 'create', calling method: .version_select at 0x7f2bb84518c8>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-347274522", "metadata": {"Type": "work"}}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:08:14.697439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-128fdab3-3ea2-42ab-9276-f427ae25103a tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.647141 Dec 21 04:08:14.698126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 371/778] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Dec 21 04:08:14 2020] POST /compute/v2.1/os-volumes => generated 352 bytes in 649 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 21 04:08:14.715585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9212e7bf-dcb3-4647-83ca-62cec6cf7ff5 tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] Calling method '.version_select at 0x7f2bb85a9268>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:14.820202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9212e7bf-dcb3-4647-83ca-62cec6cf7ff5 tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] 10.222.0.16 "GET /compute/v2.1/os-volumes/f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec" status: 200 len: 352 microversion: 2.1 time: 0.113564 Dec 21 04:08:14.820867 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 408/779] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:08:14 2020] GET /compute/v2.1/os-volumes/f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:15.183416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-de3fbdb9-86a3-4c7a-8869-0b9427fd39a8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:15.184081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-de3fbdb9-86a3-4c7a-8869-0b9427fd39a8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:15.193487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de3fbdb9-86a3-4c7a-8869-0b9427fd39a8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:15.193994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de3fbdb9-86a3-4c7a-8869-0b9427fd39a8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:15.194915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de3fbdb9-86a3-4c7a-8869-0b9427fd39a8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:15.195564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de3fbdb9-86a3-4c7a-8869-0b9427fd39a8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:15.479110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-de3fbdb9-86a3-4c7a-8869-0b9427fd39a8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:15.489482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-de3fbdb9-86a3-4c7a-8869-0b9427fd39a8 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1680 microversion: 2.1 time: 0.315035 Dec 21 04:08:15.490323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 372/780] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:15 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1680 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:15.839198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-77b65170-2033-4544-89c2-c7b453e80f0a tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] Calling method '.version_select at 0x7f2bb85a9598>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:15.944724 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-77b65170-2033-4544-89c2-c7b453e80f0a tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] 10.222.0.16 "GET /compute/v2.1/os-volumes/f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec" status: 200 len: 353 microversion: 2.1 time: 0.115212 Dec 21 04:08:15.945359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 409/781] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:08:15 2020] GET /compute/v2.1/os-volumes/f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:15.962784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-addb23cc-033e-4ed6-a500-22544e6ae857 tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] Calling method '.version_select at 0x7f2bb84516a8>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:16.065167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-addb23cc-033e-4ed6-a500-22544e6ae857 tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] 10.222.0.16 "GET /compute/v2.1/os-volumes/f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec" status: 200 len: 353 microversion: 2.1 time: 0.111886 Dec 21 04:08:16.065801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 373/782] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:08:15 2020] GET /compute/v2.1/os-volumes/f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:16.090178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8c095ca7-ef80-4695-a528-99fea568020d tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] Calling method '.version_select at 0x7f2bb8ffcf28>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:16.194153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8c095ca7-ef80-4695-a528-99fea568020d tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec" status: 202 len: 0 microversion: 2.1 time: 0.113144 Dec 21 04:08:16.195041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 410/783] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Dec 21 04:08:16 2020] DELETE /compute/v2.1/os-volumes/f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:08:16.209469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ede45ee2-f983-4474-9449-d9a5bf67d23d tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] Calling method '.version_select at 0x7f2bb83ab598>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:16.314825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ede45ee2-f983-4474-9449-d9a5bf67d23d tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] 10.222.0.16 "GET /compute/v2.1/os-volumes/f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec" status: 200 len: 352 microversion: 2.1 time: 0.113986 Dec 21 04:08:16.315909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 374/784] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:08:16 2020] GET /compute/v2.1/os-volumes/f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:08:16.518522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d5bb262d-1723-402f-8dbb-30fc9c8f0e17 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:16.519293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d5bb262d-1723-402f-8dbb-30fc9c8f0e17 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:16.527707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d5bb262d-1723-402f-8dbb-30fc9c8f0e17 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:16.528331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d5bb262d-1723-402f-8dbb-30fc9c8f0e17 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:16.529153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d5bb262d-1723-402f-8dbb-30fc9c8f0e17 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:16.529865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d5bb262d-1723-402f-8dbb-30fc9c8f0e17 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:16.757152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d5bb262d-1723-402f-8dbb-30fc9c8f0e17 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:16.766117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d5bb262d-1723-402f-8dbb-30fc9c8f0e17 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1680 microversion: 2.1 time: 0.259941 Dec 21 04:08:16.766759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 411/785] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:16 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:17.333335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ec7bbfe7-b6c7-4e17-9e42-957fd27e05ac tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] Calling method '.version_select at 0x7f2bb8744840>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:17.402283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-ec7bbfe7-b6c7-4e17-9e42-957fd27e05ac tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] HTTP exception thrown: Volume f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec could not be found. Dec 21 04:08:17.403116 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ec7bbfe7-b6c7-4e17-9e42-957fd27e05ac tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] Returning 404 to user: Volume f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:08:17.404126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ec7bbfe7-b6c7-4e17-9e42-957fd27e05ac tempest-VolumesGetTestJSON-1159832493 tempest-VolumesGetTestJSON-1159832493] 10.222.0.16 "GET /compute/v2.1/os-volumes/f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec" status: 404 len: 109 microversion: 2.1 time: 0.079723 Dec 21 04:08:17.404728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 375/786] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:08:17 2020] GET /compute/v2.1/os-volumes/f9c6f92e-5ecd-4f2e-bc11-bdd8ad6a14ec => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:08:17.790960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1dc98e5e-50b0-4a65-881e-fc16db199b4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:17.791855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1dc98e5e-50b0-4a65-881e-fc16db199b4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:17.800485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1dc98e5e-50b0-4a65-881e-fc16db199b4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:17.800994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1dc98e5e-50b0-4a65-881e-fc16db199b4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:17.801965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1dc98e5e-50b0-4a65-881e-fc16db199b4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:17.802572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1dc98e5e-50b0-4a65-881e-fc16db199b4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:18.105400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1dc98e5e-50b0-4a65-881e-fc16db199b4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:18.115715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1dc98e5e-50b0-4a65-881e-fc16db199b4c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1680 microversion: 2.1 time: 0.334201 Dec 21 04:08:18.116262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 412/787] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:17 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1680 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:19.138536 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f112da24-b5ce-406d-886d-bb2e326318f4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:19.143252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f112da24-b5ce-406d-886d-bb2e326318f4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:19.152256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f112da24-b5ce-406d-886d-bb2e326318f4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:19.152949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f112da24-b5ce-406d-886d-bb2e326318f4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:19.153767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f112da24-b5ce-406d-886d-bb2e326318f4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:19.154420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f112da24-b5ce-406d-886d-bb2e326318f4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:19.396157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f112da24-b5ce-406d-886d-bb2e326318f4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:19.405122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f112da24-b5ce-406d-886d-bb2e326318f4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1657 microversion: 2.1 time: 0.275330 Dec 21 04:08:19.405647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 376/788] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:19 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1657 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:19.429059 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1575190d-3745-4a1b-bcf4-0192af6e26de tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:08:19.437093 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1575190d-3745-4a1b-bcf4-0192af6e26de tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:19.437609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1575190d-3745-4a1b-bcf4-0192af6e26de tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:19.534507 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1575190d-3745-4a1b-bcf4-0192af6e26de tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Going to try to start instance {{(pid=94299) start /opt/stack/nova/nova/compute/api.py:2599}} Dec 21 04:08:19.622603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1575190d-3745-4a1b-bcf4-0192af6e26de tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action" status: 202 len: 0 microversion: 2.1 time: 0.203710 Dec 21 04:08:19.623390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 413/789] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:08:19 2020] POST /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 21 04:08:19.638725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f6c9fa3e-a1db-4423-a3e5-50ae5e7321b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:19.639516 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f6c9fa3e-a1db-4423-a3e5-50ae5e7321b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:19.648050 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f6c9fa3e-a1db-4423-a3e5-50ae5e7321b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:19.648771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f6c9fa3e-a1db-4423-a3e5-50ae5e7321b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:19.650292 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f6c9fa3e-a1db-4423-a3e5-50ae5e7321b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:19.651101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f6c9fa3e-a1db-4423-a3e5-50ae5e7321b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:19.894258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f6c9fa3e-a1db-4423-a3e5-50ae5e7321b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:19.903084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f6c9fa3e-a1db-4423-a3e5-50ae5e7321b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1666 microversion: 2.1 time: 0.274122 Dec 21 04:08:19.903749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 377/790] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:19 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1666 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:20.929318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-359a8c61-5ba8-479e-8b2e-19876f472069 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:20.930175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-359a8c61-5ba8-479e-8b2e-19876f472069 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:20.938192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-359a8c61-5ba8-479e-8b2e-19876f472069 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:20.939824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-359a8c61-5ba8-479e-8b2e-19876f472069 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:20.940661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-359a8c61-5ba8-479e-8b2e-19876f472069 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:20.941145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-359a8c61-5ba8-479e-8b2e-19876f472069 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:21.165700 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-359a8c61-5ba8-479e-8b2e-19876f472069 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:21.175430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-359a8c61-5ba8-479e-8b2e-19876f472069 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1666 microversion: 2.1 time: 0.257064 Dec 21 04:08:21.176085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 414/791] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:20 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1666 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:22.200081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d58e7494-3840-4243-b886-2420b8e7dc7d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:22.200642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d58e7494-3840-4243-b886-2420b8e7dc7d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:22.209714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d58e7494-3840-4243-b886-2420b8e7dc7d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:22.210228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d58e7494-3840-4243-b886-2420b8e7dc7d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:22.211154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d58e7494-3840-4243-b886-2420b8e7dc7d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:22.211651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d58e7494-3840-4243-b886-2420b8e7dc7d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:22.685266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d58e7494-3840-4243-b886-2420b8e7dc7d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:22.695431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d58e7494-3840-4243-b886-2420b8e7dc7d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1666 microversion: 2.1 time: 0.504659 Dec 21 04:08:22.696021 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 378/792] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:22 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1666 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:23.719027 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-846c5b8c-e0d8-4479-a518-9b9ac913926f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:23.719737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-846c5b8c-e0d8-4479-a518-9b9ac913926f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:23.727558 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-846c5b8c-e0d8-4479-a518-9b9ac913926f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:23.728067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-846c5b8c-e0d8-4479-a518-9b9ac913926f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:23.728906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-846c5b8c-e0d8-4479-a518-9b9ac913926f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:23.729401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-846c5b8c-e0d8-4479-a518-9b9ac913926f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:23.949514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-846c5b8c-e0d8-4479-a518-9b9ac913926f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:23.960370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-846c5b8c-e0d8-4479-a518-9b9ac913926f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1666 microversion: 2.1 time: 0.250417 Dec 21 04:08:23.960954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 415/793] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:23 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1666 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:24.983198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e9a1a98b-bd24-4de4-aa46-558decddc716 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:24.983874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e9a1a98b-bd24-4de4-aa46-558decddc716 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:24.992625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9a1a98b-bd24-4de4-aa46-558decddc716 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:24.993135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9a1a98b-bd24-4de4-aa46-558decddc716 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:24.993973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9a1a98b-bd24-4de4-aa46-558decddc716 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:24.994471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e9a1a98b-bd24-4de4-aa46-558decddc716 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:25.210467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e9a1a98b-bd24-4de4-aa46-558decddc716 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:08:25.219465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e9a1a98b-bd24-4de4-aa46-558decddc716 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1670 microversion: 2.1 time: 0.245646 Dec 21 04:08:25.220069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 379/794] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:08:24 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1670 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:08:40.258028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b87ecfaf-b8a4-4717-a29b-1a92f042a92b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:40.258575 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b87ecfaf-b8a4-4717-a29b-1a92f042a92b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:40.267564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b87ecfaf-b8a4-4717-a29b-1a92f042a92b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:40.268070 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b87ecfaf-b8a4-4717-a29b-1a92f042a92b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:40.268938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b87ecfaf-b8a4-4717-a29b-1a92f042a92b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:40.269425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b87ecfaf-b8a4-4717-a29b-1a92f042a92b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:40.342654 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b87ecfaf-b8a4-4717-a29b-1a92f042a92b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/os-volume_attachments/00439084-dd55-410e-9b02-c86f7781532b" status: 200 len: 194 microversion: 2.20 time: 0.094749 Dec 21 04:08:40.343353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 416/795] 10.222.0.16 () {60 vars in 1444 bytes} [Mon Dec 21 04:08:40 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/os-volume_attachments/00439084-dd55-410e-9b02-c86f7781532b => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:08:40.461091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bf55d98d-d3f2-421d-8cef-e803bf49b363 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:08:40.461637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bf55d98d-d3f2-421d-8cef-e803bf49b363 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:08:40.470210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf55d98d-d3f2-421d-8cef-e803bf49b363 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:40.470802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf55d98d-d3f2-421d-8cef-e803bf49b363 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:40.473529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf55d98d-d3f2-421d-8cef-e803bf49b363 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:08:40.473529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bf55d98d-d3f2-421d-8cef-e803bf49b363 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:08:40.732766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bf55d98d-d3f2-421d-8cef-e803bf49b363 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "DELETE /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/os-volume_attachments/00439084-dd55-410e-9b02-c86f7781532b" status: 202 len: 0 microversion: 2.20 time: 0.281451 Dec 21 04:08:40.733397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 380/796] 10.222.0.16 () {60 vars in 1447 bytes} [Mon Dec 21 04:08:40 2020] DELETE /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de/os-volume_attachments/00439084-dd55-410e-9b02-c86f7781532b => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:09:04.978066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dd89c7b3-5fa9-488d-8f1a-ee87292db3b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:04.978785 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dd89c7b3-5fa9-488d-8f1a-ee87292db3b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:04.986763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dd89c7b3-5fa9-488d-8f1a-ee87292db3b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:04.987304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dd89c7b3-5fa9-488d-8f1a-ee87292db3b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:04.988132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dd89c7b3-5fa9-488d-8f1a-ee87292db3b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:04.988624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dd89c7b3-5fa9-488d-8f1a-ee87292db3b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:05.066401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dd89c7b3-5fa9-488d-8f1a-ee87292db3b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Going to try to terminate instance {{(pid=94299) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:09:05.184766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dd89c7b3-5fa9-488d-8f1a-ee87292db3b7 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "DELETE /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 204 len: 0 microversion: 2.1 time: 0.215910 Dec 21 04:09:05.185442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 417/797] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:09:04 2020] DELETE /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:09:05.202566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-68065753-fcbc-425d-bd8b-60d4eab2d79c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:05.203912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-68065753-fcbc-425d-bd8b-60d4eab2d79c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:05.212180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68065753-fcbc-425d-bd8b-60d4eab2d79c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:05.212694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68065753-fcbc-425d-bd8b-60d4eab2d79c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:05.213521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68065753-fcbc-425d-bd8b-60d4eab2d79c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:05.214011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68065753-fcbc-425d-bd8b-60d4eab2d79c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:05.777467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-68065753-fcbc-425d-bd8b-60d4eab2d79c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:05.786364 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-68065753-fcbc-425d-bd8b-60d4eab2d79c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1676 microversion: 2.1 time: 0.593939 Dec 21 04:09:05.786968 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 381/798] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:05 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1676 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:06.810778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-74b1a673-e030-4459-a76a-8454188eb33d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:06.811584 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-74b1a673-e030-4459-a76a-8454188eb33d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:06.819809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-74b1a673-e030-4459-a76a-8454188eb33d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:06.820322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-74b1a673-e030-4459-a76a-8454188eb33d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:06.821156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-74b1a673-e030-4459-a76a-8454188eb33d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:06.821671 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-74b1a673-e030-4459-a76a-8454188eb33d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:07.127483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-74b1a673-e030-4459-a76a-8454188eb33d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:07.136380 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-74b1a673-e030-4459-a76a-8454188eb33d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1676 microversion: 2.1 time: 0.335414 Dec 21 04:09:07.136969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 418/799] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:06 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1676 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:08.159672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-251848a5-69a6-40ba-a830-4705fc3cc33a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:08.160345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-251848a5-69a6-40ba-a830-4705fc3cc33a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:08.168260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-251848a5-69a6-40ba-a830-4705fc3cc33a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:08.168776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-251848a5-69a6-40ba-a830-4705fc3cc33a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:08.169618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-251848a5-69a6-40ba-a830-4705fc3cc33a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:08.170114 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-251848a5-69a6-40ba-a830-4705fc3cc33a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:08.562268 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-251848a5-69a6-40ba-a830-4705fc3cc33a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:08.575080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-251848a5-69a6-40ba-a830-4705fc3cc33a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1608 microversion: 2.1 time: 0.424604 Dec 21 04:09:08.578403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 382/800] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:08 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1608 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:08.914637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-a540fe45-65b3-403c-8ff7-de4d0582c802 req-d6060577-01e9-4e8e-a66f-88551373e270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c", "name": "network-vif-deleted", "tag": "f383262c-f81f-4b3d-a438-e84aba847b2b"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:08.921415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:08.921415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:09:08.930393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-a540fe45-65b3-403c-8ff7-de4d0582c802 req-d6060577-01e9-4e8e-a66f-88551373e270 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:08.930894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-a540fe45-65b3-403c-8ff7-de4d0582c802 req-d6060577-01e9-4e8e-a66f-88551373e270 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:08.949300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-a540fe45-65b3-403c-8ff7-de4d0582c802 req-d6060577-01e9-4e8e-a66f-88551373e270 service nova] Creating event network-vif-deleted:f383262c-f81f-4b3d-a438-e84aba847b2b for instance 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c on hv-cinder-73306 Dec 21 04:09:08.955176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-a540fe45-65b3-403c-8ff7-de4d0582c802 req-d6060577-01e9-4e8e-a66f-88551373e270 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050215 Dec 21 04:09:08.956050 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 419/801] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:09:08 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:09:09.096504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4b68defa-2fa8-4f62-acd5-b78e693519ea tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:09.097018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4b68defa-2fa8-4f62-acd5-b78e693519ea tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:09.105019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b68defa-2fa8-4f62-acd5-b78e693519ea tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:09.105499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b68defa-2fa8-4f62-acd5-b78e693519ea tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:09.106340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b68defa-2fa8-4f62-acd5-b78e693519ea tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:09.106831 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b68defa-2fa8-4f62-acd5-b78e693519ea tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:09.174069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-4b68defa-2fa8-4f62-acd5-b78e693519ea tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lazy-loading 'flavor' on Instance uuid 56c04726-583d-4c58-82b1-5baccee7c4a7 {{(pid=94298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:09:09.366836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4b68defa-2fa8-4f62-acd5-b78e693519ea tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "POST /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7/action" status: 202 len: 0 microversion: 2.1 time: 0.280067 Dec 21 04:09:09.368107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 383/802] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:09 2020] POST /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:09:09.383464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2b2aaeb1-4fe3-4db9-a4bc-6a757ec8bcce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:09.384356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2b2aaeb1-4fe3-4db9-a4bc-6a757ec8bcce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:09.396203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2b2aaeb1-4fe3-4db9-a4bc-6a757ec8bcce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:09.396832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2b2aaeb1-4fe3-4db9-a4bc-6a757ec8bcce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:09.397755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2b2aaeb1-4fe3-4db9-a4bc-6a757ec8bcce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:09.398583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2b2aaeb1-4fe3-4db9-a4bc-6a757ec8bcce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:09.600167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5c07ff68-cc1d-4ab2-b41b-98f3467c2231 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:09.604824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5c07ff68-cc1d-4ab2-b41b-98f3467c2231 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:09.627355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5c07ff68-cc1d-4ab2-b41b-98f3467c2231 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:09.627871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5c07ff68-cc1d-4ab2-b41b-98f3467c2231 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:09.628899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5c07ff68-cc1d-4ab2-b41b-98f3467c2231 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:09.629461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5c07ff68-cc1d-4ab2-b41b-98f3467c2231 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:09.708736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2b2aaeb1-4fe3-4db9-a4bc-6a757ec8bcce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:09.718640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2b2aaeb1-4fe3-4db9-a4bc-6a757ec8bcce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.345925 Dec 21 04:09:09.730283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 420/803] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:09 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:09.826572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5c07ff68-cc1d-4ab2-b41b-98f3467c2231 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:09.835898 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5c07ff68-cc1d-4ab2-b41b-98f3467c2231 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1608 microversion: 2.1 time: 0.246256 Dec 21 04:09:09.837188 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 384/804] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:09 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1608 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:10.747502 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-557b0184-c7f4-4975-834b-fba3f108ef0b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:10.748776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-557b0184-c7f4-4975-834b-fba3f108ef0b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:10.757103 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-557b0184-c7f4-4975-834b-fba3f108ef0b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:10.757730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-557b0184-c7f4-4975-834b-fba3f108ef0b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:10.758664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-557b0184-c7f4-4975-834b-fba3f108ef0b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:10.759268 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-557b0184-c7f4-4975-834b-fba3f108ef0b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:10.861164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7fdc2240-3524-4126-a5bd-2e9f6a773b07 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:10.862037 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7fdc2240-3524-4126-a5bd-2e9f6a773b07 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:10.875835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7fdc2240-3524-4126-a5bd-2e9f6a773b07 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:10.876461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7fdc2240-3524-4126-a5bd-2e9f6a773b07 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:10.877470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7fdc2240-3524-4126-a5bd-2e9f6a773b07 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:10.878336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7fdc2240-3524-4126-a5bd-2e9f6a773b07 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:11.021732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-557b0184-c7f4-4975-834b-fba3f108ef0b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:11.035736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-557b0184-c7f4-4975-834b-fba3f108ef0b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.300703 Dec 21 04:09:11.037011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 421/805] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:10 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:11.039820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7fdc2240-3524-4126-a5bd-2e9f6a773b07 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:11.049468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7fdc2240-3524-4126-a5bd-2e9f6a773b07 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 200 len: 1323 microversion: 2.1 time: 0.199444 Dec 21 04:09:11.050064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 385/806] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:10 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:12.061736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-77871a4c-f319-4075-ade4-7b75b60bd658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:12.063254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-77871a4c-f319-4075-ade4-7b75b60bd658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:12.071651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-77871a4c-f319-4075-ade4-7b75b60bd658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:12.072461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-77871a4c-f319-4075-ade4-7b75b60bd658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:12.073520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-77871a4c-f319-4075-ade4-7b75b60bd658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:12.073860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-424d49ee-c53c-44da-a5cc-cdd60216eb02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:12.074424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-77871a4c-f319-4075-ade4-7b75b60bd658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:12.074538 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-424d49ee-c53c-44da-a5cc-cdd60216eb02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:12.083520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-424d49ee-c53c-44da-a5cc-cdd60216eb02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:12.084031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-424d49ee-c53c-44da-a5cc-cdd60216eb02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:12.084882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-424d49ee-c53c-44da-a5cc-cdd60216eb02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:12.085384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-424d49ee-c53c-44da-a5cc-cdd60216eb02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:12.148697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-424d49ee-c53c-44da-a5cc-cdd60216eb02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] HTTP exception thrown: Instance 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c could not be found. Dec 21 04:09:12.149348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-424d49ee-c53c-44da-a5cc-cdd60216eb02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Returning 404 to user: Instance 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:09:12.150694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-424d49ee-c53c-44da-a5cc-cdd60216eb02 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 404 len: 111 microversion: 2.1 time: 0.086977 Dec 21 04:09:12.151329 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 386/807] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:12 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:09:12.169436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-be8db0bb-07d4-4a9f-85cb-ca0d03f581dc tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '.version_select at 0x7f2bb8451950>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:12.196416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-be8db0bb-07d4-4a9f-85cb-ca0d03f581dc tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161064162" status: 202 len: 0 microversion: 2.1 time: 0.036121 Dec 21 04:09:12.197228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 387/808] 10.222.0.16 () {58 vars in 1211 bytes} [Mon Dec 21 04:09:12 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161064162 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:09:12.308118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-77871a4c-f319-4075-ade4-7b75b60bd658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:12.317827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-77871a4c-f319-4075-ade4-7b75b60bd658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.265084 Dec 21 04:09:12.318430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 422/809] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:12 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:13.343167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ee5704fd-1794-4935-8098-0543b1f76006 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:13.344623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ee5704fd-1794-4935-8098-0543b1f76006 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:13.353341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee5704fd-1794-4935-8098-0543b1f76006 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:13.354036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee5704fd-1794-4935-8098-0543b1f76006 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:13.355126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee5704fd-1794-4935-8098-0543b1f76006 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:13.355948 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ee5704fd-1794-4935-8098-0543b1f76006 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:13.365366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-37190678-a777-471e-98b5-57b359a37e64 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'create', calling method: .version_select at 0x7f2bbd27b268>, body: {"keypair": {"name": "tempest-keypair-1951984485"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:13.395570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-37190678-a777-471e-98b5-57b359a37e64 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Getting quotas for project f527547042444d469350a38850143d5a. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:09:13.399981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-37190678-a777-471e-98b5-57b359a37e64 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Getting quotas for user bc28a0b363024c9d97f3be0a04b1bd33 and project f527547042444d469350a38850143d5a. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:09:13.607632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ee5704fd-1794-4935-8098-0543b1f76006 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:13.616939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ee5704fd-1794-4935-8098-0543b1f76006 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.283674 Dec 21 04:09:13.617532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 388/810] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:13 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:13.627162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e08118b4-68a6-4d43-a974-5cb56d3cb7d5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:13.627817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e08118b4-68a6-4d43-a974-5cb56d3cb7d5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:13.635351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e08118b4-68a6-4d43-a974-5cb56d3cb7d5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:13.635810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e08118b4-68a6-4d43-a974-5cb56d3cb7d5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:13.636631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e08118b4-68a6-4d43-a974-5cb56d3cb7d5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:13.637122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e08118b4-68a6-4d43-a974-5cb56d3cb7d5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:13.735664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-37190678-a777-471e-98b5-57b359a37e64 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Getting quotas for project f527547042444d469350a38850143d5a. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:09:13.740201 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-37190678-a777-471e-98b5-57b359a37e64 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Getting quotas for user bc28a0b363024c9d97f3be0a04b1bd33 and project f527547042444d469350a38850143d5a. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:09:13.754779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-37190678-a777-471e-98b5-57b359a37e64 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.398984 Dec 21 04:09:13.755643 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 423/811] 10.222.0.16 () {60 vars in 1148 bytes} [Mon Dec 21 04:09:13 2020] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:13.856544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e08118b4-68a6-4d43-a974-5cb56d3cb7d5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:13.866541 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e08118b4-68a6-4d43-a974-5cb56d3cb7d5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1596 microversion: 2.1 time: 0.247944 Dec 21 04:09:13.867354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 389/812] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:13 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1596 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:13.891382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-521d38b3-1529-40c0-a634-4694250fe55e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Action: 'create', calling method: .version_select at 0x7f2bb91b1730>, body: {"pool": null} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:14.641343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bbe82caa-19c4-4d8c-8788-4181a5a88e77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:14.642015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bbe82caa-19c4-4d8c-8788-4181a5a88e77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:14.649718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bbe82caa-19c4-4d8c-8788-4181a5a88e77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:14.650454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bbe82caa-19c4-4d8c-8788-4181a5a88e77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:14.651306 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bbe82caa-19c4-4d8c-8788-4181a5a88e77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:14.651941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bbe82caa-19c4-4d8c-8788-4181a5a88e77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:15.058676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bbe82caa-19c4-4d8c-8788-4181a5a88e77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:15.070074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bbe82caa-19c4-4d8c-8788-4181a5a88e77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.438507 Dec 21 04:09:15.071257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 390/813] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:14 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:16.095553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-632fd3d6-2cce-49c4-b387-9c134f521600 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:16.096981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-632fd3d6-2cce-49c4-b387-9c134f521600 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:16.106741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-632fd3d6-2cce-49c4-b387-9c134f521600 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:16.107604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-632fd3d6-2cce-49c4-b387-9c134f521600 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:16.108678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-632fd3d6-2cce-49c4-b387-9c134f521600 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:16.110542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-632fd3d6-2cce-49c4-b387-9c134f521600 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:16.306880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-521d38b3-1529-40c0-a634-4694250fe55e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.425758 Dec 21 04:09:16.307549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 424/814] 10.222.0.16 () {60 vars in 1160 bytes} [Mon Dec 21 04:09:13 2020] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:09:16.319631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-87366135", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8d33767-b253-441c-91c7-8b1cb39a6139"}], "security_groups": [{"name": "tempest-securitygroup--1428957001"}], "key_name": "tempest-keypair-1951984485", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:16.358016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-632fd3d6-2cce-49c4-b387-9c134f521600 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:16.368186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-632fd3d6-2cce-49c4-b387-9c134f521600 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.283668 Dec 21 04:09:16.368771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 391/815] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:16 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:16.380577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9c2abba2-2968-4f1a-9e63-afcf04444122 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Action: 'action', calling method: .version_select at 0x7f2bb9dabf28>, body: {"addFloatingIp": {"address": "172.27.0.191"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:16.381859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9c2abba2-2968-4f1a-9e63-afcf04444122 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:16.389578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c2abba2-2968-4f1a-9e63-afcf04444122 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:16.390064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c2abba2-2968-4f1a-9e63-afcf04444122 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:16.391160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c2abba2-2968-4f1a-9e63-afcf04444122 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:16.391840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c2abba2-2968-4f1a-9e63-afcf04444122 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:16.461456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c2abba2-2968-4f1a-9e63-afcf04444122 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Acquired lock "refresh_cache-daa828a0-c810-48fe-8ea0-866c312aeb98" {{(pid=94298) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 21 04:09:16.485417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] validate_networks() for [('e8d33767-b253-441c-91c7-8b1cb39a6139', None, None, None)] {{(pid=94299) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:09:17.152766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Flavor limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:09:17.153556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Image limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:09:17.154099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Flavor pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:09:17.154551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Image pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:09:17.155022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:09:17.165018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:17.165519 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:17.166432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:17.166870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:17.185515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Getting quotas for project f527547042444d469350a38850143d5a. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:09:17.190003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Getting quotas for user bc28a0b363024c9d97f3be0a04b1bd33 and project f527547042444d469350a38850143d5a. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:09:17.201552 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Going to run 1 instances... {{(pid=94299) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:09:17.204736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:09:17.261153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5b5e6cce-917d-4b90-a868-893d3d252ae6 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.952282 Dec 21 04:09:17.262083 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 425/816] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:09:16 2020] POST /compute/v2.1/servers => generated 402 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:09:17.278754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1a754b73-19b8-4827-afdc-e4768272eec1 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:17.279885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1a754b73-19b8-4827-afdc-e4768272eec1 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:17.383929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1a754b73-19b8-4827-afdc-e4768272eec1 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:17.394875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1a754b73-19b8-4827-afdc-e4768272eec1 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1236 microversion: 2.1 time: 0.125630 Dec 21 04:09:17.402840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 426/817] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:17 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1236 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:17.405835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9a65d2cd-907a-4744-90c3-1deadf34bb34 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:17.407213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9a65d2cd-907a-4744-90c3-1deadf34bb34 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:17.418621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9a65d2cd-907a-4744-90c3-1deadf34bb34 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:17.419338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9a65d2cd-907a-4744-90c3-1deadf34bb34 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:17.420187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9a65d2cd-907a-4744-90c3-1deadf34bb34 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:17.420678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9a65d2cd-907a-4744-90c3-1deadf34bb34 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:17.735745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9a65d2cd-907a-4744-90c3-1deadf34bb34 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:17.745497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9a65d2cd-907a-4744-90c3-1deadf34bb34 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.348676 Dec 21 04:09:17.746405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 427/818] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:17 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:18.418642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-26339472-0995-4353-a4e7-0398eb5fc178 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:18.419356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-26339472-0995-4353-a4e7-0398eb5fc178 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:18.428040 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26339472-0995-4353-a4e7-0398eb5fc178 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:18.428547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26339472-0995-4353-a4e7-0398eb5fc178 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:18.429417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26339472-0995-4353-a4e7-0398eb5fc178 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:18.429865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26339472-0995-4353-a4e7-0398eb5fc178 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:18.439316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-9c2abba2-2968-4f1a-9e63-afcf04444122 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Building network info cache for instance {{(pid=94298) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 21 04:09:18.583359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-26339472-0995-4353-a4e7-0398eb5fc178 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:18.592544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-26339472-0995-4353-a4e7-0398eb5fc178 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1288 microversion: 2.1 time: 0.182943 Dec 21 04:09:18.593274 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 428/819] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:18 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1288 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:18.604772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-b449b6a8-eabf-475f-b36d-231aceb98d1d req-79d7f3a0-4956-4b73-9366-7915a28da9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa828a0-c810-48fe-8ea0-866c312aeb98", "tag": "a286529e-ec58-4881-9bf1-0a30fd25f4af"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:18.611802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:18.611802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:09:18.621212 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-b449b6a8-eabf-475f-b36d-231aceb98d1d req-79d7f3a0-4956-4b73-9366-7915a28da9b5 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:18.621712 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-b449b6a8-eabf-475f-b36d-231aceb98d1d req-79d7f3a0-4956-4b73-9366-7915a28da9b5 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:18.644771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-b449b6a8-eabf-475f-b36d-231aceb98d1d req-79d7f3a0-4956-4b73-9366-7915a28da9b5 service nova] Creating event network-changed:a286529e-ec58-4881-9bf1-0a30fd25f4af for instance daa828a0-c810-48fe-8ea0-866c312aeb98 on hv-cinder-73306 Dec 21 04:09:18.650244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-b449b6a8-eabf-475f-b36d-231aceb98d1d req-79d7f3a0-4956-4b73-9366-7915a28da9b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055003 Dec 21 04:09:18.650942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 429/820] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:09:18 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:09:18.781807 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e0f8d7c4-1bf3-4c2a-9611-d2e1a35a7ef2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:18.788397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e0f8d7c4-1bf3-4c2a-9611-d2e1a35a7ef2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:18.802051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e0f8d7c4-1bf3-4c2a-9611-d2e1a35a7ef2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:18.815659 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e0f8d7c4-1bf3-4c2a-9611-d2e1a35a7ef2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:18.816873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e0f8d7c4-1bf3-4c2a-9611-d2e1a35a7ef2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:18.817570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e0f8d7c4-1bf3-4c2a-9611-d2e1a35a7ef2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:19.061433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e0f8d7c4-1bf3-4c2a-9611-d2e1a35a7ef2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:19.073045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e0f8d7c4-1bf3-4c2a-9611-d2e1a35a7ef2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.311696 Dec 21 04:09:19.073979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 430/821] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:18 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:19.617952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dc446c46-92ad-49cb-8157-5c4b8e68a918 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:19.618619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dc446c46-92ad-49cb-8157-5c4b8e68a918 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:19.627288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc446c46-92ad-49cb-8157-5c4b8e68a918 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:19.627792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc446c46-92ad-49cb-8157-5c4b8e68a918 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:19.628627 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc446c46-92ad-49cb-8157-5c4b8e68a918 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:19.629118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc446c46-92ad-49cb-8157-5c4b8e68a918 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:19.768740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dc446c46-92ad-49cb-8157-5c4b8e68a918 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:19.779146 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dc446c46-92ad-49cb-8157-5c4b8e68a918 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1294 microversion: 2.1 time: 0.171235 Dec 21 04:09:19.780000 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 431/822] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:19 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1294 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:20.098674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5b96b41b-0496-49b6-b4bf-b183f8b8233b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:20.099383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5b96b41b-0496-49b6-b4bf-b183f8b8233b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:20.107509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b96b41b-0496-49b6-b4bf-b183f8b8233b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:20.108175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b96b41b-0496-49b6-b4bf-b183f8b8233b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:20.109018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b96b41b-0496-49b6-b4bf-b183f8b8233b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:20.109936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b96b41b-0496-49b6-b4bf-b183f8b8233b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:20.347849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5b96b41b-0496-49b6-b4bf-b183f8b8233b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:20.356993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5b96b41b-0496-49b6-b4bf-b183f8b8233b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.268371 Dec 21 04:09:20.357888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 432/823] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:20 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:20.803536 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-88c9f552-4289-4b35-b6e2-0e8c8fa7668c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:20.804216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-88c9f552-4289-4b35-b6e2-0e8c8fa7668c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:20.812018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88c9f552-4289-4b35-b6e2-0e8c8fa7668c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:20.813144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88c9f552-4289-4b35-b6e2-0e8c8fa7668c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:20.813977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88c9f552-4289-4b35-b6e2-0e8c8fa7668c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:20.814461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88c9f552-4289-4b35-b6e2-0e8c8fa7668c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:20.947696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-9c2abba2-2968-4f1a-9e63-afcf04444122 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Updating instance_info_cache with network_info: [{"id": "a286529e-ec58-4881-9bf1-0a30fd25f4af", "address": "fa:16:3e:81:40:84", "network": {"id": "78dad1cc-329d-4b16-a292-99bbc6a23af7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1496133927-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c854b1b3076d4532ac6b8813b4df1ab6", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapa286529e-ec", "ovs_interfaceid": "a286529e-ec58-4881-9bf1-0a30fd25f4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94298) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 21 04:09:20.954866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-88c9f552-4289-4b35-b6e2-0e8c8fa7668c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:20.961951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c2abba2-2968-4f1a-9e63-afcf04444122 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Releasing lock "refresh_cache-daa828a0-c810-48fe-8ea0-866c312aeb98" {{(pid=94298) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 21 04:09:20.963509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9c2abba2-2968-4f1a-9e63-afcf04444122 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "POST /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/action" status: 202 len: 0 microversion: 2.1 time: 4.593105 Dec 21 04:09:20.967420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-88c9f552-4289-4b35-b6e2-0e8c8fa7668c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1294 microversion: 2.1 time: 0.171049 Dec 21 04:09:20.967420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 433/824] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:20 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1294 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:20.971146 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 392/825] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:16 2020] POST /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/action => generated 0 bytes in 4598 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 21 04:09:20.978032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d60c6f58-7302-4179-b459-fbed40fc5351 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Action: 'create', calling method: .version_select at 0x7f2bb83e1730>, body: {"security_group": {"name": "tempest-TestMinimumBasicScenario-1211628095", "description": "tempest-TestMinimumBasicScenario-1211628095 description"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:21.204633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d60c6f58-7302-4179-b459-fbed40fc5351 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 257 microversion: 2.1 time: 0.235297 Dec 21 04:09:21.207227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 434/826] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Dec 21 04:09:20 2020] POST /compute/v2.1/os-security-groups => generated 257 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:09:21.223273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-16065cac-d0e5-47fd-b432-7f220594c177 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Action: 'create', calling method: .version_select at 0x7f2bb90b71e0>, body: {"security_group_rule": {"parent_group_id": "fe7d78e4-796e-4202-a68c-7a0163cad230", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:21.380825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0427f1ed-9a6e-44c9-9fad-4d121d2f18e4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:21.381500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0427f1ed-9a6e-44c9-9fad-4d121d2f18e4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:21.390087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0427f1ed-9a6e-44c9-9fad-4d121d2f18e4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:21.390595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0427f1ed-9a6e-44c9-9fad-4d121d2f18e4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:21.391542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0427f1ed-9a6e-44c9-9fad-4d121d2f18e4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:21.392034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0427f1ed-9a6e-44c9-9fad-4d121d2f18e4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:21.617230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0427f1ed-9a6e-44c9-9fad-4d121d2f18e4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:21.627062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0427f1ed-9a6e-44c9-9fad-4d121d2f18e4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.255958 Dec 21 04:09:21.627885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 435/827] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:21 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:21.989955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fe26b3ef-cf72-4c05-a520-b97031a67dcf tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:21.990453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fe26b3ef-cf72-4c05-a520-b97031a67dcf tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:21.998395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-16065cac-d0e5-47fd-b432-7f220594c177 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.784793 Dec 21 04:09:21.998547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe26b3ef-cf72-4c05-a520-b97031a67dcf tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:21.998920 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe26b3ef-cf72-4c05-a520-b97031a67dcf tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:21.999601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 393/828] 10.222.0.16 () {60 vars in 1185 bytes} [Mon Dec 21 04:09:21 2020] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:09:21.999966 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe26b3ef-cf72-4c05-a520-b97031a67dcf tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:22.000586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe26b3ef-cf72-4c05-a520-b97031a67dcf tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:22.017219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1003e7ad-511f-4946-a62f-41032f0eb1bb tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Action: 'create', calling method: .version_select at 0x7f2bb86a6620>, body: {"security_group_rule": {"parent_group_id": "fe7d78e4-796e-4202-a68c-7a0163cad230", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:22.255719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fe26b3ef-cf72-4c05-a520-b97031a67dcf tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:22.265421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fe26b3ef-cf72-4c05-a520-b97031a67dcf tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1362 microversion: 2.1 time: 0.286192 Dec 21 04:09:22.271914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 436/829] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:21 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:22.651029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d3653f6e-cd4e-43a7-b2ea-ec8956d10085 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:22.651702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d3653f6e-cd4e-43a7-b2ea-ec8956d10085 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:22.660178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3653f6e-cd4e-43a7-b2ea-ec8956d10085 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:22.660693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3653f6e-cd4e-43a7-b2ea-ec8956d10085 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:22.661524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3653f6e-cd4e-43a7-b2ea-ec8956d10085 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:22.662019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3653f6e-cd4e-43a7-b2ea-ec8956d10085 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:22.914611 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d3653f6e-cd4e-43a7-b2ea-ec8956d10085 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:22.924579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d3653f6e-cd4e-43a7-b2ea-ec8956d10085 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.282651 Dec 21 04:09:22.925291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 437/830] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:22 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:22.926666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1003e7ad-511f-4946-a62f-41032f0eb1bb tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.919736 Dec 21 04:09:22.927470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 394/831] 10.222.0.16 () {60 vars in 1185 bytes} [Mon Dec 21 04:09:22 2020] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:09:22.947726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1611d050-e7eb-4d5d-ac73-cf0642254969 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1211628095"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:22.948321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1611d050-e7eb-4d5d-ac73-cf0642254969 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:22.956507 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1611d050-e7eb-4d5d-ac73-cf0642254969 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:22.957014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1611d050-e7eb-4d5d-ac73-cf0642254969 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:22.957850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1611d050-e7eb-4d5d-ac73-cf0642254969 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:22.958352 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1611d050-e7eb-4d5d-ac73-cf0642254969 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:23.187910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.network.security_group_api [None req-1611d050-e7eb-4d5d-ac73-cf0642254969 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Adding security group fe7d78e4-796e-4202-a68c-7a0163cad230 to port a286529e-ec58-4881-9bf1-0a30fd25f4af Dec 21 04:09:23.290402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9a8dc7fa-39a4-4d5b-a11a-6ae971c4749c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:23.291528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9a8dc7fa-39a4-4d5b-a11a-6ae971c4749c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:23.301119 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9a8dc7fa-39a4-4d5b-a11a-6ae971c4749c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:23.302268 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9a8dc7fa-39a4-4d5b-a11a-6ae971c4749c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:23.304025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9a8dc7fa-39a4-4d5b-a11a-6ae971c4749c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:23.304734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9a8dc7fa-39a4-4d5b-a11a-6ae971c4749c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:23.940042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1611d050-e7eb-4d5d-ac73-cf0642254969 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "POST /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/action" status: 202 len: 0 microversion: 2.1 time: 1.001824 Dec 21 04:09:23.941149 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 438/832] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:22 2020] POST /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/action => generated 0 bytes in 1003 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:09:23.956396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-22209be5-3d2f-47ed-bf9b-50192242f3a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:23.957050 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-22209be5-3d2f-47ed-bf9b-50192242f3a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:23.978778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-22209be5-3d2f-47ed-bf9b-50192242f3a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:23.981216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-22209be5-3d2f-47ed-bf9b-50192242f3a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:23.981825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-22209be5-3d2f-47ed-bf9b-50192242f3a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:23.982325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-22209be5-3d2f-47ed-bf9b-50192242f3a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:24.043056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9a8dc7fa-39a4-4d5b-a11a-6ae971c4749c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:24.052948 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9a8dc7fa-39a4-4d5b-a11a-6ae971c4749c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1362 microversion: 2.1 time: 0.773243 Dec 21 04:09:24.053833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 395/833] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:23 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1362 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:24.080667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7a923f74-9427-4ac1-9f1f-6f447b85449f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:24.081342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7a923f74-9427-4ac1-9f1f-6f447b85449f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:24.094437 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a923f74-9427-4ac1-9f1f-6f447b85449f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:24.094985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a923f74-9427-4ac1-9f1f-6f447b85449f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:24.095837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a923f74-9427-4ac1-9f1f-6f447b85449f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:24.096519 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a923f74-9427-4ac1-9f1f-6f447b85449f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:24.261863 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-22209be5-3d2f-47ed-bf9b-50192242f3a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:24.273246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-22209be5-3d2f-47ed-bf9b-50192242f3a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.330284 Dec 21 04:09:24.285126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 439/834] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:23 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:24.398991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-74c01a32-342b-4f0b-b223-86c28f40b3c3 req-91bef501-8f9f-4293-81ee-0128fde79ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa828a0-c810-48fe-8ea0-866c312aeb98", "tag": "a286529e-ec58-4881-9bf1-0a30fd25f4af"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:24.406270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:24.406270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:09:24.415381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-74c01a32-342b-4f0b-b223-86c28f40b3c3 req-91bef501-8f9f-4293-81ee-0128fde79ac1 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:24.415865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-74c01a32-342b-4f0b-b223-86c28f40b3c3 req-91bef501-8f9f-4293-81ee-0128fde79ac1 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:24.434831 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-74c01a32-342b-4f0b-b223-86c28f40b3c3 req-91bef501-8f9f-4293-81ee-0128fde79ac1 service nova] Creating event network-changed:a286529e-ec58-4881-9bf1-0a30fd25f4af for instance daa828a0-c810-48fe-8ea0-866c312aeb98 on hv-cinder-73306 Dec 21 04:09:24.440675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-74c01a32-342b-4f0b-b223-86c28f40b3c3 req-91bef501-8f9f-4293-81ee-0128fde79ac1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154086 Dec 21 04:09:24.441710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 440/835] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:09:24 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:09:24.726501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-1e270764-9431-4d97-a638-68704179c88f req-b8501f60-4a47-4c20-8a4c-20cf032267d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01a14ee-b77e-4ed8-a7e7-deff054230f2", "tag": "d85524f1-3da1-4673-85c8-375bc346d0de"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:24.736761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:24.736761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:09:24.748137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-1e270764-9431-4d97-a638-68704179c88f req-b8501f60-4a47-4c20-8a4c-20cf032267d6 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:24.748678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-1e270764-9431-4d97-a638-68704179c88f req-b8501f60-4a47-4c20-8a4c-20cf032267d6 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:24.771643 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-1e270764-9431-4d97-a638-68704179c88f req-b8501f60-4a47-4c20-8a4c-20cf032267d6 service nova] Creating event network-changed:d85524f1-3da1-4673-85c8-375bc346d0de for instance c01a14ee-b77e-4ed8-a7e7-deff054230f2 on hv-cinder-73306 Dec 21 04:09:24.776612 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-1e270764-9431-4d97-a638-68704179c88f req-b8501f60-4a47-4c20-8a4c-20cf032267d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062606 Dec 21 04:09:24.777350 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 441/836] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:09:24 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:09:24.935011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7a923f74-9427-4ac1-9f1f-6f447b85449f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:24.946375 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7a923f74-9427-4ac1-9f1f-6f447b85449f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1772 microversion: 2.1 time: 0.891119 Dec 21 04:09:24.947378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 396/837] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:24 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1772 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:25.077666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1ece39af-469b-4fc1-a2d2-50d6d640f425 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:25.079108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1ece39af-469b-4fc1-a2d2-50d6d640f425 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:25.087467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ece39af-469b-4fc1-a2d2-50d6d640f425 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:25.087977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ece39af-469b-4fc1-a2d2-50d6d640f425 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:25.088820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ece39af-469b-4fc1-a2d2-50d6d640f425 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:25.089298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ece39af-469b-4fc1-a2d2-50d6d640f425 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:25.297145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-44891216-375b-40ea-8dd5-ae7b3a7c2aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:25.298414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-44891216-375b-40ea-8dd5-ae7b3a7c2aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:25.306823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44891216-375b-40ea-8dd5-ae7b3a7c2aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:25.307537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44891216-375b-40ea-8dd5-ae7b3a7c2aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:25.308542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44891216-375b-40ea-8dd5-ae7b3a7c2aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:25.308772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1ece39af-469b-4fc1-a2d2-50d6d640f425 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:25.309211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44891216-375b-40ea-8dd5-ae7b3a7c2aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:25.318968 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1ece39af-469b-4fc1-a2d2-50d6d640f425 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1362 microversion: 2.1 time: 0.251365 Dec 21 04:09:25.329906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 442/838] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:25 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:25.803801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-44891216-375b-40ea-8dd5-ae7b3a7c2aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:25.813353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-44891216-375b-40ea-8dd5-ae7b3a7c2aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.525064 Dec 21 04:09:25.813965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 397/839] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:25 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:26.241938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-aea4a609-3fc3-422b-be6a-c7bebe2664c7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:26.243067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-aea4a609-3fc3-422b-be6a-c7bebe2664c7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:26.252192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aea4a609-3fc3-422b-be6a-c7bebe2664c7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:26.252715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aea4a609-3fc3-422b-be6a-c7bebe2664c7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:26.253563 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aea4a609-3fc3-422b-be6a-c7bebe2664c7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:26.254060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aea4a609-3fc3-422b-be6a-c7bebe2664c7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:26.341666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-704c390e-1676-43c1-9c91-bf1af80fb11c req-c463b969-1f24-48e6-a299-e04dc95184d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c04726-583d-4c58-82b1-5baccee7c4a7", "name": "network-vif-unplugged", "status": "completed", "tag": "499c69ca-3c31-461f-a533-f5bccf8a38fe"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:26.348468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:26.348468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:09:26.357778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-704c390e-1676-43c1-9c91-bf1af80fb11c req-c463b969-1f24-48e6-a299-e04dc95184d1 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:26.358529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-704c390e-1676-43c1-9c91-bf1af80fb11c req-c463b969-1f24-48e6-a299-e04dc95184d1 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:26.379756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-704c390e-1676-43c1-9c91-bf1af80fb11c req-c463b969-1f24-48e6-a299-e04dc95184d1 service nova] Creating event network-vif-unplugged:499c69ca-3c31-461f-a533-f5bccf8a38fe for instance 56c04726-583d-4c58-82b1-5baccee7c4a7 on hv-cinder-73306 Dec 21 04:09:26.385067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-704c390e-1676-43c1-9c91-bf1af80fb11c req-c463b969-1f24-48e6-a299-e04dc95184d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052711 Dec 21 04:09:26.385708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 398/840] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:09:26 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:09:26.396543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-508ec09d-7505-4709-920d-6ec548d3201d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:26.397565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-508ec09d-7505-4709-920d-6ec548d3201d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:26.406630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-508ec09d-7505-4709-920d-6ec548d3201d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:26.407566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-508ec09d-7505-4709-920d-6ec548d3201d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:26.408583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-508ec09d-7505-4709-920d-6ec548d3201d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:26.409236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-508ec09d-7505-4709-920d-6ec548d3201d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:26.422456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-aea4a609-3fc3-422b-be6a-c7bebe2664c7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "POST /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/action" status: 202 len: 0 microversion: 2.1 time: 0.189511 Dec 21 04:09:26.426748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 443/841] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:26 2020] POST /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:09:26.460848 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2e4df544-7a00-4653-bb61-c9c5e2b68b0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:26.461623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2e4df544-7a00-4653-bb61-c9c5e2b68b0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:26.471820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e4df544-7a00-4653-bb61-c9c5e2b68b0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:26.472337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e4df544-7a00-4653-bb61-c9c5e2b68b0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:26.473213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e4df544-7a00-4653-bb61-c9c5e2b68b0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:26.473774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e4df544-7a00-4653-bb61-c9c5e2b68b0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:26.703530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2e4df544-7a00-4653-bb61-c9c5e2b68b0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:26.713456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2e4df544-7a00-4653-bb61-c9c5e2b68b0d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1764 microversion: 2.1 time: 0.275018 Dec 21 04:09:26.714075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 444/842] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:26 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1764 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:26.837157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7b03617d-33bf-42a5-807a-ac30b78e30ce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:26.837966 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7b03617d-33bf-42a5-807a-ac30b78e30ce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:26.847588 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b03617d-33bf-42a5-807a-ac30b78e30ce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:26.848096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b03617d-33bf-42a5-807a-ac30b78e30ce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:26.848965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b03617d-33bf-42a5-807a-ac30b78e30ce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:26.849462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b03617d-33bf-42a5-807a-ac30b78e30ce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:27.071600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7b03617d-33bf-42a5-807a-ac30b78e30ce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:27.081210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7b03617d-33bf-42a5-807a-ac30b78e30ce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.253848 Dec 21 04:09:27.081812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 445/843] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:26 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:27.212980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-508ec09d-7505-4709-920d-6ec548d3201d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:27.222882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-508ec09d-7505-4709-920d-6ec548d3201d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1362 microversion: 2.1 time: 0.835766 Dec 21 04:09:27.223513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 399/844] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:26 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1362 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:27.739006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-75605a3a-0607-4946-8656-6bb211e2eea0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:27.739950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-75605a3a-0607-4946-8656-6bb211e2eea0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:27.747977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75605a3a-0607-4946-8656-6bb211e2eea0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:27.748485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75605a3a-0607-4946-8656-6bb211e2eea0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:27.749325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75605a3a-0607-4946-8656-6bb211e2eea0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:27.750547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75605a3a-0607-4946-8656-6bb211e2eea0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:27.969018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-75605a3a-0607-4946-8656-6bb211e2eea0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:27.978501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-75605a3a-0607-4946-8656-6bb211e2eea0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1764 microversion: 2.1 time: 0.249263 Dec 21 04:09:27.979112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 446/845] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:27 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1764 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:28.105559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5b48834a-4080-40c0-9c37-9552345b3f75 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:28.106227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5b48834a-4080-40c0-9c37-9552345b3f75 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:28.115029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b48834a-4080-40c0-9c37-9552345b3f75 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:28.115542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b48834a-4080-40c0-9c37-9552345b3f75 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:28.116388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b48834a-4080-40c0-9c37-9552345b3f75 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:28.116891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5b48834a-4080-40c0-9c37-9552345b3f75 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:28.247875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ec770b9e-2a62-4786-a5a9-c30663aa5a9a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:28.248606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ec770b9e-2a62-4786-a5a9-c30663aa5a9a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:28.258654 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec770b9e-2a62-4786-a5a9-c30663aa5a9a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:28.259387 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec770b9e-2a62-4786-a5a9-c30663aa5a9a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:28.260231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec770b9e-2a62-4786-a5a9-c30663aa5a9a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:28.260770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec770b9e-2a62-4786-a5a9-c30663aa5a9a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:28.354625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5b48834a-4080-40c0-9c37-9552345b3f75 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:28.364212 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5b48834a-4080-40c0-9c37-9552345b3f75 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.267994 Dec 21 04:09:28.365097 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 400/846] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:28 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:28.490489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ec770b9e-2a62-4786-a5a9-c30663aa5a9a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:28.491373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-1aaa387b-b994-4147-bbc2-e869c2d5e664 req-89b43737-c312-49ff-a9ef-52ba01faaa86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01a14ee-b77e-4ed8-a7e7-deff054230f2", "name": "network-vif-plugged", "status": "completed", "tag": "d85524f1-3da1-4673-85c8-375bc346d0de"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:28.498342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:28.498342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:09:28.500049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ec770b9e-2a62-4786-a5a9-c30663aa5a9a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1362 microversion: 2.1 time: 0.262093 Dec 21 04:09:28.500646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 447/847] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:28 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:28.507384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-1aaa387b-b994-4147-bbc2-e869c2d5e664 req-89b43737-c312-49ff-a9ef-52ba01faaa86 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:28.507890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-1aaa387b-b994-4147-bbc2-e869c2d5e664 req-89b43737-c312-49ff-a9ef-52ba01faaa86 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:28.525558 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-1aaa387b-b994-4147-bbc2-e869c2d5e664 req-89b43737-c312-49ff-a9ef-52ba01faaa86 service nova] Creating event network-vif-plugged:d85524f1-3da1-4673-85c8-375bc346d0de for instance c01a14ee-b77e-4ed8-a7e7-deff054230f2 on hv-cinder-73306 Dec 21 04:09:28.530395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-1aaa387b-b994-4147-bbc2-e869c2d5e664 req-89b43737-c312-49ff-a9ef-52ba01faaa86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133063 Dec 21 04:09:28.531737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 401/848] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:09:28 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:09:29.003927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4d968b7a-11e0-4b55-8fc5-ce5d0d0b4b47 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:29.004594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4d968b7a-11e0-4b55-8fc5-ce5d0d0b4b47 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:29.012533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d968b7a-11e0-4b55-8fc5-ce5d0d0b4b47 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:29.013046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d968b7a-11e0-4b55-8fc5-ce5d0d0b4b47 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:29.013885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d968b7a-11e0-4b55-8fc5-ce5d0d0b4b47 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:29.014382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d968b7a-11e0-4b55-8fc5-ce5d0d0b4b47 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:29.234761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4d968b7a-11e0-4b55-8fc5-ce5d0d0b4b47 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:29.244717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4d968b7a-11e0-4b55-8fc5-ce5d0d0b4b47 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1769 microversion: 2.1 time: 0.250912 Dec 21 04:09:29.245311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 448/849] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:28 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1769 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:29.389140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cba8a9e2-839c-4ac9-b79a-92ae490eb3d2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:29.389913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cba8a9e2-839c-4ac9-b79a-92ae490eb3d2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:29.398002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cba8a9e2-839c-4ac9-b79a-92ae490eb3d2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:29.398508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cba8a9e2-839c-4ac9-b79a-92ae490eb3d2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:29.399374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cba8a9e2-839c-4ac9-b79a-92ae490eb3d2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:29.399866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cba8a9e2-839c-4ac9-b79a-92ae490eb3d2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:29.523518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8508bf02-991e-4782-89fc-3ad3fecabb87 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:29.524196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8508bf02-991e-4782-89fc-3ad3fecabb87 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:29.532823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8508bf02-991e-4782-89fc-3ad3fecabb87 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:29.533325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8508bf02-991e-4782-89fc-3ad3fecabb87 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:29.534210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8508bf02-991e-4782-89fc-3ad3fecabb87 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:29.534701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8508bf02-991e-4782-89fc-3ad3fecabb87 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:29.621370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cba8a9e2-839c-4ac9-b79a-92ae490eb3d2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:29.630426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cba8a9e2-839c-4ac9-b79a-92ae490eb3d2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.250819 Dec 21 04:09:29.631043 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 402/850] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:29 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:29.751823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8508bf02-991e-4782-89fc-3ad3fecabb87 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:29.760551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8508bf02-991e-4782-89fc-3ad3fecabb87 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1362 microversion: 2.1 time: 0.246704 Dec 21 04:09:29.761150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 449/851] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:29 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:30.270172 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4ad35775-9a83-4526-a6eb-722c48056cee tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:30.270951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4ad35775-9a83-4526-a6eb-722c48056cee tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:30.278596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4ad35775-9a83-4526-a6eb-722c48056cee tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:30.279171 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4ad35775-9a83-4526-a6eb-722c48056cee tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:30.280010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4ad35775-9a83-4526-a6eb-722c48056cee tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:30.280482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4ad35775-9a83-4526-a6eb-722c48056cee tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:30.503196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4ad35775-9a83-4526-a6eb-722c48056cee tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:30.512856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4ad35775-9a83-4526-a6eb-722c48056cee tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1769 microversion: 2.1 time: 0.252476 Dec 21 04:09:30.513658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 403/852] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:30 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1769 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:30.653956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bcfa9196-2e9f-430f-84b5-9be24ac0bc18 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:30.654557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bcfa9196-2e9f-430f-84b5-9be24ac0bc18 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:30.662508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bcfa9196-2e9f-430f-84b5-9be24ac0bc18 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:30.663048 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bcfa9196-2e9f-430f-84b5-9be24ac0bc18 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:30.663879 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bcfa9196-2e9f-430f-84b5-9be24ac0bc18 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:30.664372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bcfa9196-2e9f-430f-84b5-9be24ac0bc18 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:30.784005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6b296697-0d15-41d2-9b0c-57f04d3f5830 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:30.784674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6b296697-0d15-41d2-9b0c-57f04d3f5830 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:30.792619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6b296697-0d15-41d2-9b0c-57f04d3f5830 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:30.793128 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6b296697-0d15-41d2-9b0c-57f04d3f5830 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:30.793964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6b296697-0d15-41d2-9b0c-57f04d3f5830 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:30.794459 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6b296697-0d15-41d2-9b0c-57f04d3f5830 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:30.887002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bcfa9196-2e9f-430f-84b5-9be24ac0bc18 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:30.896260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bcfa9196-2e9f-430f-84b5-9be24ac0bc18 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.251499 Dec 21 04:09:30.897042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 450/853] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:30 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:31.013198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6b296697-0d15-41d2-9b0c-57f04d3f5830 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:31.022619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6b296697-0d15-41d2-9b0c-57f04d3f5830 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1548 microversion: 2.1 time: 0.247760 Dec 21 04:09:31.023242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 404/854] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:30 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1548 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:31.044788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b43e8d17-6d3c-400b-b55f-b6b61caa1a9b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:31.045328 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b43e8d17-6d3c-400b-b55f-b6b61caa1a9b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:31.059226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b43e8d17-6d3c-400b-b55f-b6b61caa1a9b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:31.059739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b43e8d17-6d3c-400b-b55f-b6b61caa1a9b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:31.060570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b43e8d17-6d3c-400b-b55f-b6b61caa1a9b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:31.061060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b43e8d17-6d3c-400b-b55f-b6b61caa1a9b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:31.217287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b43e8d17-6d3c-400b-b55f-b6b61caa1a9b tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181468 Dec 21 04:09:31.217932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 451/855] 10.222.0.16 () {58 vars in 1265 bytes} [Mon Dec 21 04:09:31 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:09:31.537184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d4236511-730d-4bbb-a8e4-5734d7441004 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:31.537848 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d4236511-730d-4bbb-a8e4-5734d7441004 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:31.545827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4236511-730d-4bbb-a8e4-5734d7441004 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:31.546847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4236511-730d-4bbb-a8e4-5734d7441004 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:31.547709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4236511-730d-4bbb-a8e4-5734d7441004 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:31.548196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4236511-730d-4bbb-a8e4-5734d7441004 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:31.779324 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d4236511-730d-4bbb-a8e4-5734d7441004 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:31.790169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d4236511-730d-4bbb-a8e4-5734d7441004 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1769 microversion: 2.1 time: 0.262052 Dec 21 04:09:31.791014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 405/856] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:31 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1769 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:31.920131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fbb8ccfc-3fa0-491c-ae59-3b88dfb4e406 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:31.920801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fbb8ccfc-3fa0-491c-ae59-3b88dfb4e406 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:31.929527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbb8ccfc-3fa0-491c-ae59-3b88dfb4e406 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:31.930034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbb8ccfc-3fa0-491c-ae59-3b88dfb4e406 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:31.930864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbb8ccfc-3fa0-491c-ae59-3b88dfb4e406 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:31.931384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbb8ccfc-3fa0-491c-ae59-3b88dfb4e406 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:32.378851 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fbb8ccfc-3fa0-491c-ae59-3b88dfb4e406 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:32.387737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fbb8ccfc-3fa0-491c-ae59-3b88dfb4e406 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.476799 Dec 21 04:09:32.388331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 452/857] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:31 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:32.815395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c4e61d94-bc81-493c-82c9-d2260d1ed033 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:32.816062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c4e61d94-bc81-493c-82c9-d2260d1ed033 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:32.823973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c4e61d94-bc81-493c-82c9-d2260d1ed033 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:32.824480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c4e61d94-bc81-493c-82c9-d2260d1ed033 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:32.825314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c4e61d94-bc81-493c-82c9-d2260d1ed033 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:32.825806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c4e61d94-bc81-493c-82c9-d2260d1ed033 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:33.033090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d5ae85c1-75b4-4f6e-b604-843e9c75dd23 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:33.034323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d5ae85c1-75b4-4f6e-b604-843e9c75dd23 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:33.042398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d5ae85c1-75b4-4f6e-b604-843e9c75dd23 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:33.042968 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d5ae85c1-75b4-4f6e-b604-843e9c75dd23 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:33.043786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d5ae85c1-75b4-4f6e-b604-843e9c75dd23 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:33.044455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d5ae85c1-75b4-4f6e-b604-843e9c75dd23 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:33.062934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c4e61d94-bc81-493c-82c9-d2260d1ed033 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:33.072817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c4e61d94-bc81-493c-82c9-d2260d1ed033 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1769 microversion: 2.1 time: 0.267089 Dec 21 04:09:33.075402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 406/858] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:32 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1769 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:33.084095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-aad50cb7-4a34-43bf-aeda-43c1cca5159a req-a0f32f4d-18dc-435a-b395-e94b380ad82a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01a14ee-b77e-4ed8-a7e7-deff054230f2", "tag": "d85524f1-3da1-4673-85c8-375bc346d0de"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:33.091203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:33.091203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:09:33.100256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-aad50cb7-4a34-43bf-aeda-43c1cca5159a req-a0f32f4d-18dc-435a-b395-e94b380ad82a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:33.100761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-aad50cb7-4a34-43bf-aeda-43c1cca5159a req-a0f32f4d-18dc-435a-b395-e94b380ad82a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:33.119272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-aad50cb7-4a34-43bf-aeda-43c1cca5159a req-a0f32f4d-18dc-435a-b395-e94b380ad82a service nova] Creating event network-changed:d85524f1-3da1-4673-85c8-375bc346d0de for instance c01a14ee-b77e-4ed8-a7e7-deff054230f2 on hv-cinder-73306 Dec 21 04:09:33.124405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-aad50cb7-4a34-43bf-aeda-43c1cca5159a req-a0f32f4d-18dc-435a-b395-e94b380ad82a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049757 Dec 21 04:09:33.125725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 407/859] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:09:33 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:09:33.169597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d5ae85c1-75b4-4f6e-b604-843e9c75dd23 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 14 microversion: 2.1 time: 0.145973 Dec 21 04:09:33.170366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 453/860] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:33 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 21 04:09:33.411729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-301b1cf7-6b18-4c1f-b0f7-8c6c8ed02a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:33.412491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-301b1cf7-6b18-4c1f-b0f7-8c6c8ed02a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:33.420767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-301b1cf7-6b18-4c1f-b0f7-8c6c8ed02a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:33.421244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-301b1cf7-6b18-4c1f-b0f7-8c6c8ed02a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:33.422093 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-301b1cf7-6b18-4c1f-b0f7-8c6c8ed02a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:33.422648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-301b1cf7-6b18-4c1f-b0f7-8c6c8ed02a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:33.766856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-301b1cf7-6b18-4c1f-b0f7-8c6c8ed02a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:33.776730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-301b1cf7-6b18-4c1f-b0f7-8c6c8ed02a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.374649 Dec 21 04:09:33.777338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 408/861] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:33 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:34.098640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7c28e012-b433-4888-8815-4fbbb21cd011 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:34.099444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7c28e012-b433-4888-8815-4fbbb21cd011 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:34.108085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7c28e012-b433-4888-8815-4fbbb21cd011 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:34.108562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7c28e012-b433-4888-8815-4fbbb21cd011 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:34.110165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7c28e012-b433-4888-8815-4fbbb21cd011 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:34.110660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7c28e012-b433-4888-8815-4fbbb21cd011 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:34.187517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4f43af0a-d779-43bb-8a37-0dadf4f6f205 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:34.188574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4f43af0a-d779-43bb-8a37-0dadf4f6f205 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:34.196816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f43af0a-d779-43bb-8a37-0dadf4f6f205 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:34.197320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f43af0a-d779-43bb-8a37-0dadf4f6f205 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:34.198154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f43af0a-d779-43bb-8a37-0dadf4f6f205 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:34.198644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f43af0a-d779-43bb-8a37-0dadf4f6f205 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:34.309488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4f43af0a-d779-43bb-8a37-0dadf4f6f205 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 14 microversion: 2.1 time: 0.131227 Dec 21 04:09:34.310254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 409/862] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:34 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 21 04:09:34.342243 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7c28e012-b433-4888-8815-4fbbb21cd011 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:34.352870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7c28e012-b433-4888-8815-4fbbb21cd011 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1769 microversion: 2.1 time: 0.264731 Dec 21 04:09:34.353585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 454/863] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:34 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1769 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:34.800754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d1a855b4-c06c-4fc9-82d3-f5479186bc97 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:34.801428 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d1a855b4-c06c-4fc9-82d3-f5479186bc97 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:34.810134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d1a855b4-c06c-4fc9-82d3-f5479186bc97 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:34.810623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d1a855b4-c06c-4fc9-82d3-f5479186bc97 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:34.811483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d1a855b4-c06c-4fc9-82d3-f5479186bc97 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:34.812502 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d1a855b4-c06c-4fc9-82d3-f5479186bc97 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:35.260747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d1a855b4-c06c-4fc9-82d3-f5479186bc97 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:35.269781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d1a855b4-c06c-4fc9-82d3-f5479186bc97 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.479047 Dec 21 04:09:35.270374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 410/864] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:34 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:35.325846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4b312430-aed7-47fa-87cb-9203b86b0c08 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:35.326938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4b312430-aed7-47fa-87cb-9203b86b0c08 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:35.336086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b312430-aed7-47fa-87cb-9203b86b0c08 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:35.336588 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b312430-aed7-47fa-87cb-9203b86b0c08 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:35.337413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b312430-aed7-47fa-87cb-9203b86b0c08 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:35.337900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b312430-aed7-47fa-87cb-9203b86b0c08 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:35.376912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-07ed4e0c-177a-476a-a05f-8b6a7d04e5ad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:35.377577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-07ed4e0c-177a-476a-a05f-8b6a7d04e5ad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:35.385450 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-07ed4e0c-177a-476a-a05f-8b6a7d04e5ad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:35.385961 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-07ed4e0c-177a-476a-a05f-8b6a7d04e5ad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:35.386798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-07ed4e0c-177a-476a-a05f-8b6a7d04e5ad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:35.387322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-07ed4e0c-177a-476a-a05f-8b6a7d04e5ad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:35.444557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4b312430-aed7-47fa-87cb-9203b86b0c08 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 14 microversion: 2.1 time: 0.127538 Dec 21 04:09:35.448451 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 455/865] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:35 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:09:35.603562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-07ed4e0c-177a-476a-a05f-8b6a7d04e5ad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:35.613884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-07ed4e0c-177a-476a-a05f-8b6a7d04e5ad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1769 microversion: 2.1 time: 0.246661 Dec 21 04:09:35.614480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 411/866] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:35 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1769 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:36.294408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8c9d83d9-db49-4887-b6c6-1b5fe9c0f1f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:36.295207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8c9d83d9-db49-4887-b6c6-1b5fe9c0f1f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:36.304047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8c9d83d9-db49-4887-b6c6-1b5fe9c0f1f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:36.304558 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8c9d83d9-db49-4887-b6c6-1b5fe9c0f1f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:36.305384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8c9d83d9-db49-4887-b6c6-1b5fe9c0f1f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:36.305875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8c9d83d9-db49-4887-b6c6-1b5fe9c0f1f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:36.463608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-56e0347d-1ee1-47d3-a3d6-e17eddccf961 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:36.464646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-56e0347d-1ee1-47d3-a3d6-e17eddccf961 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:36.473774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56e0347d-1ee1-47d3-a3d6-e17eddccf961 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:36.474276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56e0347d-1ee1-47d3-a3d6-e17eddccf961 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:36.475174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56e0347d-1ee1-47d3-a3d6-e17eddccf961 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:36.475664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56e0347d-1ee1-47d3-a3d6-e17eddccf961 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:36.527342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8c9d83d9-db49-4887-b6c6-1b5fe9c0f1f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:36.536427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8c9d83d9-db49-4887-b6c6-1b5fe9c0f1f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.251771 Dec 21 04:09:36.537028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 456/867] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:36 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:36.598027 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-56e0347d-1ee1-47d3-a3d6-e17eddccf961 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 14 microversion: 2.1 time: 0.145196 Dec 21 04:09:36.598707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 412/868] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:36 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:09:36.637640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2d1344a5-9eb3-447d-a55d-c9ffdb10d550 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:36.638310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2d1344a5-9eb3-447d-a55d-c9ffdb10d550 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:36.646282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d1344a5-9eb3-447d-a55d-c9ffdb10d550 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:36.646795 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d1344a5-9eb3-447d-a55d-c9ffdb10d550 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:36.647652 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d1344a5-9eb3-447d-a55d-c9ffdb10d550 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:36.648148 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d1344a5-9eb3-447d-a55d-c9ffdb10d550 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:36.866676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2d1344a5-9eb3-447d-a55d-c9ffdb10d550 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:36.876636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2d1344a5-9eb3-447d-a55d-c9ffdb10d550 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1769 microversion: 2.1 time: 0.248264 Dec 21 04:09:36.877228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 457/869] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:36 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1769 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:37.562536 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2ec1678e-f94e-4183-9e1a-cc696bc7d3ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:37.563343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2ec1678e-f94e-4183-9e1a-cc696bc7d3ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:37.571903 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ec1678e-f94e-4183-9e1a-cc696bc7d3ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:37.572409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ec1678e-f94e-4183-9e1a-cc696bc7d3ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:37.573236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ec1678e-f94e-4183-9e1a-cc696bc7d3ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:37.573727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ec1678e-f94e-4183-9e1a-cc696bc7d3ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:37.614927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-10552eeb-97b1-42bc-9c31-a11178569342 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:37.615971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-10552eeb-97b1-42bc-9c31-a11178569342 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:37.624917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10552eeb-97b1-42bc-9c31-a11178569342 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:37.625433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10552eeb-97b1-42bc-9c31-a11178569342 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:37.626273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10552eeb-97b1-42bc-9c31-a11178569342 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:37.626766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10552eeb-97b1-42bc-9c31-a11178569342 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:37.732877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-10552eeb-97b1-42bc-9c31-a11178569342 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 14 microversion: 2.1 time: 0.127679 Dec 21 04:09:37.736981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 458/870] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:37 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 21 04:09:37.792984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2ec1678e-f94e-4183-9e1a-cc696bc7d3ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:37.802507 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2ec1678e-f94e-4183-9e1a-cc696bc7d3ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.250438 Dec 21 04:09:37.803126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 413/871] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:37 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:37.900941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8114c7f0-f5ae-4c23-8a81-f24a77d157c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:37.901714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8114c7f0-f5ae-4c23-8a81-f24a77d157c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:37.911209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8114c7f0-f5ae-4c23-8a81-f24a77d157c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:37.911720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8114c7f0-f5ae-4c23-8a81-f24a77d157c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:37.912547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8114c7f0-f5ae-4c23-8a81-f24a77d157c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:37.913037 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8114c7f0-f5ae-4c23-8a81-f24a77d157c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:38.135800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8114c7f0-f5ae-4c23-8a81-f24a77d157c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:38.145784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8114c7f0-f5ae-4c23-8a81-f24a77d157c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1769 microversion: 2.1 time: 0.254573 Dec 21 04:09:38.146366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 459/872] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:37 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1769 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:38.751202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8ec467c3-ecd9-4724-86a9-9ab40b21b97d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:38.752181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8ec467c3-ecd9-4724-86a9-9ab40b21b97d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:38.760529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8ec467c3-ecd9-4724-86a9-9ab40b21b97d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:38.761036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8ec467c3-ecd9-4724-86a9-9ab40b21b97d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:38.761865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8ec467c3-ecd9-4724-86a9-9ab40b21b97d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:38.762358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8ec467c3-ecd9-4724-86a9-9ab40b21b97d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:38.826108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c1c7fa71-3e94-49f3-a68f-fc0cec3fa40e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:38.826772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c1c7fa71-3e94-49f3-a68f-fc0cec3fa40e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:38.834821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1c7fa71-3e94-49f3-a68f-fc0cec3fa40e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:38.835356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1c7fa71-3e94-49f3-a68f-fc0cec3fa40e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:38.836192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1c7fa71-3e94-49f3-a68f-fc0cec3fa40e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:38.836686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1c7fa71-3e94-49f3-a68f-fc0cec3fa40e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:38.865465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8ec467c3-ecd9-4724-86a9-9ab40b21b97d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 14 microversion: 2.1 time: 0.123629 Dec 21 04:09:38.869002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 414/873] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:38 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:09:39.056763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c1c7fa71-3e94-49f3-a68f-fc0cec3fa40e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:39.066213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c1c7fa71-3e94-49f3-a68f-fc0cec3fa40e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.249187 Dec 21 04:09:39.066802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 460/874] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:38 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:39.170753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bd726719-397f-4698-8b19-cd62573fc140 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:39.172298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bd726719-397f-4698-8b19-cd62573fc140 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:39.180846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bd726719-397f-4698-8b19-cd62573fc140 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:39.181347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bd726719-397f-4698-8b19-cd62573fc140 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:39.182175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bd726719-397f-4698-8b19-cd62573fc140 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:39.182667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bd726719-397f-4698-8b19-cd62573fc140 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:39.402807 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bd726719-397f-4698-8b19-cd62573fc140 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:39.412842 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bd726719-397f-4698-8b19-cd62573fc140 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1769 microversion: 2.1 time: 0.251762 Dec 21 04:09:39.413438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 415/875] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:39 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1769 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:39.881891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-387b02c4-b6df-4486-bb58-5d73b81c004f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:39.882951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-387b02c4-b6df-4486-bb58-5d73b81c004f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:39.891353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-387b02c4-b6df-4486-bb58-5d73b81c004f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:39.891858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-387b02c4-b6df-4486-bb58-5d73b81c004f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:39.892675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-387b02c4-b6df-4486-bb58-5d73b81c004f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:39.893164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-387b02c4-b6df-4486-bb58-5d73b81c004f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:39.998369 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-387b02c4-b6df-4486-bb58-5d73b81c004f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 14 microversion: 2.1 time: 0.125232 Dec 21 04:09:39.999067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 461/876] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:39 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:09:40.089844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-336f67da-be16-4494-aa61-e1f991b2ac66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:40.090449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-336f67da-be16-4494-aa61-e1f991b2ac66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:40.098422 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-336f67da-be16-4494-aa61-e1f991b2ac66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:40.098937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-336f67da-be16-4494-aa61-e1f991b2ac66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:40.099793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-336f67da-be16-4494-aa61-e1f991b2ac66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:40.100287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-336f67da-be16-4494-aa61-e1f991b2ac66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:40.318166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-336f67da-be16-4494-aa61-e1f991b2ac66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:40.327104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-336f67da-be16-4494-aa61-e1f991b2ac66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.246248 Dec 21 04:09:40.327835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 416/877] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:40 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:40.438538 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b2fb09cb-7452-4ce3-a8e3-532e247d37b5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:40.439345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b2fb09cb-7452-4ce3-a8e3-532e247d37b5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:40.448052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b2fb09cb-7452-4ce3-a8e3-532e247d37b5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:40.448565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b2fb09cb-7452-4ce3-a8e3-532e247d37b5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:40.449404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b2fb09cb-7452-4ce3-a8e3-532e247d37b5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:40.449895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b2fb09cb-7452-4ce3-a8e3-532e247d37b5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:40.673901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b2fb09cb-7452-4ce3-a8e3-532e247d37b5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:40.683325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b2fb09cb-7452-4ce3-a8e3-532e247d37b5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1769 microversion: 2.1 time: 0.255265 Dec 21 04:09:40.683920 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 462/878] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:40 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1769 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:41.014913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bb825644-b643-4f2c-8c12-c0a57223a693 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:41.015975 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bb825644-b643-4f2c-8c12-c0a57223a693 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:41.023875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bb825644-b643-4f2c-8c12-c0a57223a693 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:41.024383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bb825644-b643-4f2c-8c12-c0a57223a693 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:41.025217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bb825644-b643-4f2c-8c12-c0a57223a693 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:41.025711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bb825644-b643-4f2c-8c12-c0a57223a693 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:41.128445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bb825644-b643-4f2c-8c12-c0a57223a693 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 14 microversion: 2.1 time: 0.122490 Dec 21 04:09:41.129114 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 417/879] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:41 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:09:41.351045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5f5c6238-991e-495e-bc14-de91005bec22 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:41.351646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5f5c6238-991e-495e-bc14-de91005bec22 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:41.359713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5f5c6238-991e-495e-bc14-de91005bec22 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:41.360220 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5f5c6238-991e-495e-bc14-de91005bec22 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:41.361049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5f5c6238-991e-495e-bc14-de91005bec22 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:41.361541 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5f5c6238-991e-495e-bc14-de91005bec22 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:41.579973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5f5c6238-991e-495e-bc14-de91005bec22 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:41.588798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5f5c6238-991e-495e-bc14-de91005bec22 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.247703 Dec 21 04:09:41.589389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 463/880] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:41 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:41.708264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f40b8d09-1b9f-4133-8acd-5bcea783bd1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:41.708964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f40b8d09-1b9f-4133-8acd-5bcea783bd1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:41.717546 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f40b8d09-1b9f-4133-8acd-5bcea783bd1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:41.718745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f40b8d09-1b9f-4133-8acd-5bcea783bd1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:41.719613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f40b8d09-1b9f-4133-8acd-5bcea783bd1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:41.720110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f40b8d09-1b9f-4133-8acd-5bcea783bd1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:41.941940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f40b8d09-1b9f-4133-8acd-5bcea783bd1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:41.951297 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f40b8d09-1b9f-4133-8acd-5bcea783bd1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1769 microversion: 2.1 time: 0.252872 Dec 21 04:09:41.951904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 418/881] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:41 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1769 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:42.145655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-54c190d6-1fb6-49f0-8817-8878ffd93266 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:42.146702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-54c190d6-1fb6-49f0-8817-8878ffd93266 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:42.154574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-54c190d6-1fb6-49f0-8817-8878ffd93266 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:42.155143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-54c190d6-1fb6-49f0-8817-8878ffd93266 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:42.156683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-54c190d6-1fb6-49f0-8817-8878ffd93266 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:42.157176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-54c190d6-1fb6-49f0-8817-8878ffd93266 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:42.262636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-54c190d6-1fb6-49f0-8817-8878ffd93266 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 14 microversion: 2.1 time: 0.126356 Dec 21 04:09:42.263336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 464/882] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:42 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 21 04:09:42.613416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6c684be2-1af5-4053-9b80-8b6e6e24bda5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:42.614085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6c684be2-1af5-4053-9b80-8b6e6e24bda5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:42.622230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c684be2-1af5-4053-9b80-8b6e6e24bda5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:42.622738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c684be2-1af5-4053-9b80-8b6e6e24bda5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:42.623594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c684be2-1af5-4053-9b80-8b6e6e24bda5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:42.624721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c684be2-1af5-4053-9b80-8b6e6e24bda5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:42.974638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6c684be2-1af5-4053-9b80-8b6e6e24bda5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:42.977100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-97b7620d-7040-48d9-9f01-ae890e1ba5eb tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:42.977874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-97b7620d-7040-48d9-9f01-ae890e1ba5eb tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:42.984442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6c684be2-1af5-4053-9b80-8b6e6e24bda5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.379970 Dec 21 04:09:42.985057 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 419/883] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:42 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:42.987312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-97b7620d-7040-48d9-9f01-ae890e1ba5eb tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:42.987827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-97b7620d-7040-48d9-9f01-ae890e1ba5eb tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:42.988668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-97b7620d-7040-48d9-9f01-ae890e1ba5eb tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:42.989161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-97b7620d-7040-48d9-9f01-ae890e1ba5eb tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:43.211277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-97b7620d-7040-48d9-9f01-ae890e1ba5eb tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:43.221325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-97b7620d-7040-48d9-9f01-ae890e1ba5eb tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1769 microversion: 2.1 time: 0.254611 Dec 21 04:09:43.221912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 465/884] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:42 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1769 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:43.279705 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cfa6f827-0b24-4dda-9d12-5018d9df19e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:43.281440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cfa6f827-0b24-4dda-9d12-5018d9df19e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:43.289271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cfa6f827-0b24-4dda-9d12-5018d9df19e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:43.289771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cfa6f827-0b24-4dda-9d12-5018d9df19e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:43.290593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cfa6f827-0b24-4dda-9d12-5018d9df19e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:43.291137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cfa6f827-0b24-4dda-9d12-5018d9df19e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:43.419568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cfa6f827-0b24-4dda-9d12-5018d9df19e5 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 7429 microversion: 2.1 time: 0.148261 Dec 21 04:09:43.420417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 420/885] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:43 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 7429 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:44.007703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-41e5218c-dfc4-4354-8ff6-01646f0494e2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:44.008348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-41e5218c-dfc4-4354-8ff6-01646f0494e2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:44.017604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41e5218c-dfc4-4354-8ff6-01646f0494e2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:44.018109 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41e5218c-dfc4-4354-8ff6-01646f0494e2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:44.018973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41e5218c-dfc4-4354-8ff6-01646f0494e2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:44.019470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41e5218c-dfc4-4354-8ff6-01646f0494e2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:44.239219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-41e5218c-dfc4-4354-8ff6-01646f0494e2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:44.245622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b563fa6e-21fd-4b33-afac-011e6998040f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:44.246391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b563fa6e-21fd-4b33-afac-011e6998040f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:44.248618 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-41e5218c-dfc4-4354-8ff6-01646f0494e2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.250589 Dec 21 04:09:44.249217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 466/886] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:43 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:44.256004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b563fa6e-21fd-4b33-afac-011e6998040f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:44.256513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b563fa6e-21fd-4b33-afac-011e6998040f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:44.257348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b563fa6e-21fd-4b33-afac-011e6998040f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:44.257837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b563fa6e-21fd-4b33-afac-011e6998040f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:44.436817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-79246199-4c73-4b5e-8078-d516399fc5fc tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:44.437903 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-79246199-4c73-4b5e-8078-d516399fc5fc tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:44.446352 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-79246199-4c73-4b5e-8078-d516399fc5fc tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:44.446561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-79246199-4c73-4b5e-8078-d516399fc5fc tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:44.447568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-79246199-4c73-4b5e-8078-d516399fc5fc tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:44.447924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-79246199-4c73-4b5e-8078-d516399fc5fc tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:44.479207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b563fa6e-21fd-4b33-afac-011e6998040f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:44.490512 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b563fa6e-21fd-4b33-afac-011e6998040f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1772 microversion: 2.1 time: 0.254439 Dec 21 04:09:44.491351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 421/887] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:44 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1772 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:44.565540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-79246199-4c73-4b5e-8078-d516399fc5fc tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 15025 microversion: 2.1 time: 0.138004 Dec 21 04:09:44.566219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 467/888] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:44 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 15025 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 21 04:09:45.272724 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d4d3f99b-e399-4937-aabe-7a3d0ea1e0ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:45.273384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d4d3f99b-e399-4937-aabe-7a3d0ea1e0ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:45.282171 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4d3f99b-e399-4937-aabe-7a3d0ea1e0ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:45.282690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4d3f99b-e399-4937-aabe-7a3d0ea1e0ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:45.283537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4d3f99b-e399-4937-aabe-7a3d0ea1e0ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:45.284028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4d3f99b-e399-4937-aabe-7a3d0ea1e0ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:45.584235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ff9a48a5-293a-446c-8fd6-0c1692b12873 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:45.585305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ff9a48a5-293a-446c-8fd6-0c1692b12873 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:45.602512 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ff9a48a5-293a-446c-8fd6-0c1692b12873 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:45.603071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ff9a48a5-293a-446c-8fd6-0c1692b12873 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:45.603918 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ff9a48a5-293a-446c-8fd6-0c1692b12873 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:45.604410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ff9a48a5-293a-446c-8fd6-0c1692b12873 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:45.615184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d4d3f99b-e399-4937-aabe-7a3d0ea1e0ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:45.624411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d4d3f99b-e399-4937-aabe-7a3d0ea1e0ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.360812 Dec 21 04:09:45.625346 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 422/889] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:45 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:45.728106 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ff9a48a5-293a-446c-8fd6-0c1692b12873 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 18498 microversion: 2.1 time: 0.154130 Dec 21 04:09:45.729039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 468/890] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:45 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 18498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 21 04:09:46.648302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-300bc833-73c2-4c95-97f1-f6b763d3d394 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:46.648963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-300bc833-73c2-4c95-97f1-f6b763d3d394 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:46.657414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-300bc833-73c2-4c95-97f1-f6b763d3d394 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:46.657897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-300bc833-73c2-4c95-97f1-f6b763d3d394 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:46.658730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-300bc833-73c2-4c95-97f1-f6b763d3d394 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:46.659253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-300bc833-73c2-4c95-97f1-f6b763d3d394 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:46.746852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-356ef519-7023-4ef7-8c49-fbcf908d2614 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:46.747946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-356ef519-7023-4ef7-8c49-fbcf908d2614 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:46.757205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-356ef519-7023-4ef7-8c49-fbcf908d2614 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:46.757914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-356ef519-7023-4ef7-8c49-fbcf908d2614 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:46.758749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-356ef519-7023-4ef7-8c49-fbcf908d2614 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:46.759266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-356ef519-7023-4ef7-8c49-fbcf908d2614 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:46.879980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-300bc833-73c2-4c95-97f1-f6b763d3d394 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:46.888810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-300bc833-73c2-4c95-97f1-f6b763d3d394 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.249932 Dec 21 04:09:46.889403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 423/891] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:46 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:46.892991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-356ef519-7023-4ef7-8c49-fbcf908d2614 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 19342 microversion: 2.1 time: 0.155857 Dec 21 04:09:46.896576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 469/892] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:46 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 19342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:09:47.910724 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ae9364ae-760c-4e24-8389-88ce5e7b4629 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:47.911802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ae9364ae-760c-4e24-8389-88ce5e7b4629 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:47.914167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5e1ce837-1c7e-40e7-9989-15f0f95aab49 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:47.914993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5e1ce837-1c7e-40e7-9989-15f0f95aab49 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:47.920642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae9364ae-760c-4e24-8389-88ce5e7b4629 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:47.921157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae9364ae-760c-4e24-8389-88ce5e7b4629 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:47.922004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae9364ae-760c-4e24-8389-88ce5e7b4629 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:47.922503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae9364ae-760c-4e24-8389-88ce5e7b4629 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:47.923866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e1ce837-1c7e-40e7-9989-15f0f95aab49 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:47.924381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e1ce837-1c7e-40e7-9989-15f0f95aab49 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:47.925217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e1ce837-1c7e-40e7-9989-15f0f95aab49 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:47.925708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5e1ce837-1c7e-40e7-9989-15f0f95aab49 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:48.045404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ae9364ae-760c-4e24-8389-88ce5e7b4629 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 22540 microversion: 2.1 time: 0.144017 Dec 21 04:09:48.047017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 424/893] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:47 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 22540 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:09:48.148632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5e1ce837-1c7e-40e7-9989-15f0f95aab49 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:48.158162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5e1ce837-1c7e-40e7-9989-15f0f95aab49 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.254468 Dec 21 04:09:48.158762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 470/894] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:47 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:49.064082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-94c7d0ef-272b-463a-ac41-9caf25ca8567 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:49.065229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-94c7d0ef-272b-463a-ac41-9caf25ca8567 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:49.073868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-94c7d0ef-272b-463a-ac41-9caf25ca8567 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:49.074385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-94c7d0ef-272b-463a-ac41-9caf25ca8567 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:49.075241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-94c7d0ef-272b-463a-ac41-9caf25ca8567 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:49.075736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-94c7d0ef-272b-463a-ac41-9caf25ca8567 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:49.181933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-380a1609-7d70-4183-9cb7-6d9e268efd13 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:49.182601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-380a1609-7d70-4183-9cb7-6d9e268efd13 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:49.192433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-380a1609-7d70-4183-9cb7-6d9e268efd13 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:49.192860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-94c7d0ef-272b-463a-ac41-9caf25ca8567 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 23798 microversion: 2.1 time: 0.138784 Dec 21 04:09:49.193037 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-380a1609-7d70-4183-9cb7-6d9e268efd13 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:49.193789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 425/895] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:49 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 23798 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:09:49.193935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-380a1609-7d70-4183-9cb7-6d9e268efd13 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:49.194366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-380a1609-7d70-4183-9cb7-6d9e268efd13 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:49.412368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-380a1609-7d70-4183-9cb7-6d9e268efd13 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:49.421223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-380a1609-7d70-4183-9cb7-6d9e268efd13 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.248717 Dec 21 04:09:49.422341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 471/896] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:49 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:50.212458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-970d87e3-2dbd-4677-a0b0-ebb6e45d2cb3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:50.213527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-970d87e3-2dbd-4677-a0b0-ebb6e45d2cb3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:50.222929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-970d87e3-2dbd-4677-a0b0-ebb6e45d2cb3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:50.223469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-970d87e3-2dbd-4677-a0b0-ebb6e45d2cb3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:50.224354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-970d87e3-2dbd-4677-a0b0-ebb6e45d2cb3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:50.224926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-970d87e3-2dbd-4677-a0b0-ebb6e45d2cb3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:50.362207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-970d87e3-2dbd-4677-a0b0-ebb6e45d2cb3 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 25685 microversion: 2.1 time: 0.160336 Dec 21 04:09:50.362887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 426/897] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:50 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 25685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:09:50.445168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f5b95813-0bf5-43ce-b7c6-84d04923b395 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:50.445841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f5b95813-0bf5-43ce-b7c6-84d04923b395 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:50.454458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5b95813-0bf5-43ce-b7c6-84d04923b395 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:50.454984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5b95813-0bf5-43ce-b7c6-84d04923b395 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:50.455822 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5b95813-0bf5-43ce-b7c6-84d04923b395 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:50.456318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5b95813-0bf5-43ce-b7c6-84d04923b395 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:50.674865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f5b95813-0bf5-43ce-b7c6-84d04923b395 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:50.683658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f5b95813-0bf5-43ce-b7c6-84d04923b395 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.248143 Dec 21 04:09:50.684246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 472/898] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:50 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:51.380708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-90eeb0b8-cc1f-42ef-b45e-595dc95d2cf0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:51.381852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-90eeb0b8-cc1f-42ef-b45e-595dc95d2cf0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:51.390463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90eeb0b8-cc1f-42ef-b45e-595dc95d2cf0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:51.390999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90eeb0b8-cc1f-42ef-b45e-595dc95d2cf0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:51.391833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90eeb0b8-cc1f-42ef-b45e-595dc95d2cf0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:51.392327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90eeb0b8-cc1f-42ef-b45e-595dc95d2cf0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:51.526317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-90eeb0b8-cc1f-42ef-b45e-595dc95d2cf0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 27028 microversion: 2.1 time: 0.155173 Dec 21 04:09:51.527033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 427/899] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:51 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 27028 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:09:51.707575 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ad2ce1f5-9b33-4d9b-abd6-031827531823 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:51.708210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ad2ce1f5-9b33-4d9b-abd6-031827531823 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:51.716573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ad2ce1f5-9b33-4d9b-abd6-031827531823 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:51.717077 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ad2ce1f5-9b33-4d9b-abd6-031827531823 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:51.717898 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ad2ce1f5-9b33-4d9b-abd6-031827531823 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:51.718385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ad2ce1f5-9b33-4d9b-abd6-031827531823 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:51.933030 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ad2ce1f5-9b33-4d9b-abd6-031827531823 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:51.942417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ad2ce1f5-9b33-4d9b-abd6-031827531823 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.244607 Dec 21 04:09:51.943028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 473/900] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:51 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:09:52.544405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8e2883c4-be04-4d9f-a29d-dc582e33845c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:52.545528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8e2883c4-be04-4d9f-a29d-dc582e33845c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:52.554705 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e2883c4-be04-4d9f-a29d-dc582e33845c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:52.555258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e2883c4-be04-4d9f-a29d-dc582e33845c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:52.556083 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e2883c4-be04-4d9f-a29d-dc582e33845c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:52.556572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e2883c4-be04-4d9f-a29d-dc582e33845c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:52.675561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8e2883c4-be04-4d9f-a29d-dc582e33845c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 27720 microversion: 2.1 time: 0.140575 Dec 21 04:09:52.676294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 428/901] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:52 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 27720 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:09:52.966775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6e2a0715-b95a-4196-b00e-dd988c1ad7d9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:52.967398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6e2a0715-b95a-4196-b00e-dd988c1ad7d9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:52.975929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6e2a0715-b95a-4196-b00e-dd988c1ad7d9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:52.976433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6e2a0715-b95a-4196-b00e-dd988c1ad7d9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:52.977279 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6e2a0715-b95a-4196-b00e-dd988c1ad7d9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:52.977746 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6e2a0715-b95a-4196-b00e-dd988c1ad7d9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:53.195232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6e2a0715-b95a-4196-b00e-dd988c1ad7d9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:53.204643 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6e2a0715-b95a-4196-b00e-dd988c1ad7d9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.247245 Dec 21 04:09:53.205237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 474/902] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:52 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:53.694129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b1e2d328-95ac-4877-80dc-6e3afa055a82 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:53.695290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b1e2d328-95ac-4877-80dc-6e3afa055a82 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:53.704427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1e2d328-95ac-4877-80dc-6e3afa055a82 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:53.704931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1e2d328-95ac-4877-80dc-6e3afa055a82 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:53.705755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1e2d328-95ac-4877-80dc-6e3afa055a82 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:53.706244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1e2d328-95ac-4877-80dc-6e3afa055a82 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:53.833616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b1e2d328-95ac-4877-80dc-6e3afa055a82 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 28141 microversion: 2.1 time: 0.149362 Dec 21 04:09:53.834287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 429/903] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:53 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 28141 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:09:54.228825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-289b53dd-25db-4a88-b733-b00611f4d55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:54.229411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-289b53dd-25db-4a88-b733-b00611f4d55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:54.237971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-289b53dd-25db-4a88-b733-b00611f4d55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:54.238469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-289b53dd-25db-4a88-b733-b00611f4d55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:54.239323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-289b53dd-25db-4a88-b733-b00611f4d55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:54.240068 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-289b53dd-25db-4a88-b733-b00611f4d55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:54.457194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-289b53dd-25db-4a88-b733-b00611f4d55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:54.466280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-289b53dd-25db-4a88-b733-b00611f4d55c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.247606 Dec 21 04:09:54.466875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 475/904] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:54 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:54.852490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-47c6d9d6-510b-49f6-b94c-84da42158213 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:54.853566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-47c6d9d6-510b-49f6-b94c-84da42158213 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:54.862167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-47c6d9d6-510b-49f6-b94c-84da42158213 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:54.862674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-47c6d9d6-510b-49f6-b94c-84da42158213 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:54.863537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-47c6d9d6-510b-49f6-b94c-84da42158213 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:54.864031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-47c6d9d6-510b-49f6-b94c-84da42158213 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:54.993474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-47c6d9d6-510b-49f6-b94c-84da42158213 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 28200 microversion: 2.1 time: 0.151056 Dec 21 04:09:54.994159 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 430/905] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:54 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 28200 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:09:55.490061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2bfd4e55-2c7a-4e1f-97a9-98cc29bb9391 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:55.490726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2bfd4e55-2c7a-4e1f-97a9-98cc29bb9391 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:55.498629 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bfd4e55-2c7a-4e1f-97a9-98cc29bb9391 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:55.499196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bfd4e55-2c7a-4e1f-97a9-98cc29bb9391 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:55.500006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bfd4e55-2c7a-4e1f-97a9-98cc29bb9391 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:55.500502 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bfd4e55-2c7a-4e1f-97a9-98cc29bb9391 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:55.716669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2bfd4e55-2c7a-4e1f-97a9-98cc29bb9391 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:55.726623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2bfd4e55-2c7a-4e1f-97a9-98cc29bb9391 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.246426 Dec 21 04:09:55.727249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 476/906] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:55 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:56.012300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b563a7dd-da0f-4a77-a4b9-45026add7b6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:56.013382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b563a7dd-da0f-4a77-a4b9-45026add7b6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:56.022691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b563a7dd-da0f-4a77-a4b9-45026add7b6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:56.023223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b563a7dd-da0f-4a77-a4b9-45026add7b6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:56.024048 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b563a7dd-da0f-4a77-a4b9-45026add7b6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:56.024535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b563a7dd-da0f-4a77-a4b9-45026add7b6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:56.150657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b563a7dd-da0f-4a77-a4b9-45026add7b6f tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 28491 microversion: 2.1 time: 0.147879 Dec 21 04:09:56.151296 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 431/907] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:56 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 28491 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:09:56.751590 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0084a666-0a4b-46b8-9669-ba34a11199e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:56.752231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0084a666-0a4b-46b8-9669-ba34a11199e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:56.760087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0084a666-0a4b-46b8-9669-ba34a11199e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:56.760592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0084a666-0a4b-46b8-9669-ba34a11199e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:56.761412 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0084a666-0a4b-46b8-9669-ba34a11199e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:56.761902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0084a666-0a4b-46b8-9669-ba34a11199e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:56.977075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0084a666-0a4b-46b8-9669-ba34a11199e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:56.986593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0084a666-0a4b-46b8-9669-ba34a11199e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.244791 Dec 21 04:09:56.987219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 477/908] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:56 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:57.174420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2cb2debf-94d7-4656-862a-c366887b2edd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:57.175520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2cb2debf-94d7-4656-862a-c366887b2edd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:57.184116 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2cb2debf-94d7-4656-862a-c366887b2edd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:57.184625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2cb2debf-94d7-4656-862a-c366887b2edd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:57.185453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2cb2debf-94d7-4656-862a-c366887b2edd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:57.185943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2cb2debf-94d7-4656-862a-c366887b2edd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:57.309751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2cb2debf-94d7-4656-862a-c366887b2edd tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 28659 microversion: 2.1 time: 0.150901 Dec 21 04:09:57.310698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 432/909] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:57 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 28659 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:09:58.010453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4e1392a5-2e47-4d8c-8219-47fcf790be78 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:58.011154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4e1392a5-2e47-4d8c-8219-47fcf790be78 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:58.019174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e1392a5-2e47-4d8c-8219-47fcf790be78 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:58.019689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e1392a5-2e47-4d8c-8219-47fcf790be78 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:58.020520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e1392a5-2e47-4d8c-8219-47fcf790be78 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:58.021020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e1392a5-2e47-4d8c-8219-47fcf790be78 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:58.329426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f765bac8-2d1d-4357-8906-c791feaf6eae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:58.331537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f765bac8-2d1d-4357-8906-c791feaf6eae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:58.339511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f765bac8-2d1d-4357-8906-c791feaf6eae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:58.340018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f765bac8-2d1d-4357-8906-c791feaf6eae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:58.340871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f765bac8-2d1d-4357-8906-c791feaf6eae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:58.341363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f765bac8-2d1d-4357-8906-c791feaf6eae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:58.453329 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f765bac8-2d1d-4357-8906-c791feaf6eae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 28659 microversion: 2.1 time: 0.133882 Dec 21 04:09:58.458656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 433/910] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:58 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 28659 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 21 04:09:58.459596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4e1392a5-2e47-4d8c-8219-47fcf790be78 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:58.468579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4e1392a5-2e47-4d8c-8219-47fcf790be78 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.467573 Dec 21 04:09:58.469161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 478/911] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:57 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:09:59.474526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-49b13f9c-b5b9-4f29-b99f-0f9182cb28d4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:09:59.475726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-49b13f9c-b5b9-4f29-b99f-0f9182cb28d4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:59.484320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49b13f9c-b5b9-4f29-b99f-0f9182cb28d4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:59.484828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49b13f9c-b5b9-4f29-b99f-0f9182cb28d4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:59.486453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49b13f9c-b5b9-4f29-b99f-0f9182cb28d4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:59.486982 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49b13f9c-b5b9-4f29-b99f-0f9182cb28d4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:59.493790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8cbceabd-397c-4cd6-8580-890927c67159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:09:59.494463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8cbceabd-397c-4cd6-8580-890927c67159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:09:59.503014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8cbceabd-397c-4cd6-8580-890927c67159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:59.503527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8cbceabd-397c-4cd6-8580-890927c67159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:59.504366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8cbceabd-397c-4cd6-8580-890927c67159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:09:59.504861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8cbceabd-397c-4cd6-8580-890927c67159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:09:59.597417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-49b13f9c-b5b9-4f29-b99f-0f9182cb28d4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 28659 microversion: 2.1 time: 0.134093 Dec 21 04:09:59.598411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 434/912] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:09:59 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 28659 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:09:59.717787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8cbceabd-397c-4cd6-8580-890927c67159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:09:59.727176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8cbceabd-397c-4cd6-8580-890927c67159 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.244208 Dec 21 04:09:59.727712 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 479/913] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:09:59 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:10:00.615804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-efedba1b-7fe4-4143-8a1a-321cbe783337 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:00.616940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-efedba1b-7fe4-4143-8a1a-321cbe783337 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:00.625486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efedba1b-7fe4-4143-8a1a-321cbe783337 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:00.626768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efedba1b-7fe4-4143-8a1a-321cbe783337 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:00.627641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efedba1b-7fe4-4143-8a1a-321cbe783337 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:00.628138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efedba1b-7fe4-4143-8a1a-321cbe783337 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:00.752423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3a8261ac-4485-4178-83ce-c8a816e0db88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:00.753040 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3a8261ac-4485-4178-83ce-c8a816e0db88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:00.760064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-efedba1b-7fe4-4143-8a1a-321cbe783337 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 28717 microversion: 2.1 time: 0.154454 Dec 21 04:10:00.760978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 435/914] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:10:00 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 28717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:10:00.761147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a8261ac-4485-4178-83ce-c8a816e0db88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:00.761547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a8261ac-4485-4178-83ce-c8a816e0db88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:00.762342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a8261ac-4485-4178-83ce-c8a816e0db88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:00.762829 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a8261ac-4485-4178-83ce-c8a816e0db88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:00.981840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3a8261ac-4485-4178-83ce-c8a816e0db88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:00.991923 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3a8261ac-4485-4178-83ce-c8a816e0db88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.249530 Dec 21 04:10:00.992523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 480/915] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:00 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:01.778692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-044fb706-c579-4c60-8e85-7a24bb118436 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:01.779795 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-044fb706-c579-4c60-8e85-7a24bb118436 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:01.788430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-044fb706-c579-4c60-8e85-7a24bb118436 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:01.788969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-044fb706-c579-4c60-8e85-7a24bb118436 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:01.789794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-044fb706-c579-4c60-8e85-7a24bb118436 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:01.790280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-044fb706-c579-4c60-8e85-7a24bb118436 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:01.911343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-044fb706-c579-4c60-8e85-7a24bb118436 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 30759 microversion: 2.1 time: 0.141946 Dec 21 04:10:01.912008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 436/916] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:10:01 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 30759 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:10:02.014931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-10ab19aa-0865-465c-8161-2c37a244d3e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:02.015613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-10ab19aa-0865-465c-8161-2c37a244d3e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:02.023452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10ab19aa-0865-465c-8161-2c37a244d3e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:02.023982 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10ab19aa-0865-465c-8161-2c37a244d3e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:02.024779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10ab19aa-0865-465c-8161-2c37a244d3e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:02.025266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10ab19aa-0865-465c-8161-2c37a244d3e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:02.245385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-10ab19aa-0865-465c-8161-2c37a244d3e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:02.255493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-10ab19aa-0865-465c-8161-2c37a244d3e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.249673 Dec 21 04:10:02.256083 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 481/917] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:02 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:02.929519 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d875d325-7e25-431e-8131-896de731d596 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:02.930571 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d875d325-7e25-431e-8131-896de731d596 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:02.938869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d875d325-7e25-431e-8131-896de731d596 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:02.939397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d875d325-7e25-431e-8131-896de731d596 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:02.940222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d875d325-7e25-431e-8131-896de731d596 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:02.940713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d875d325-7e25-431e-8131-896de731d596 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:03.065791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d875d325-7e25-431e-8131-896de731d596 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 32658 microversion: 2.1 time: 0.145622 Dec 21 04:10:03.066467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 437/918] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:10:02 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 32658 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:10:03.278529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-62828b4e-6874-42c3-b555-a395fecb05f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:03.279225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-62828b4e-6874-42c3-b555-a395fecb05f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:03.287418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62828b4e-6874-42c3-b555-a395fecb05f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:03.287926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62828b4e-6874-42c3-b555-a395fecb05f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:03.288754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62828b4e-6874-42c3-b555-a395fecb05f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:03.289248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62828b4e-6874-42c3-b555-a395fecb05f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:03.506541 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-62828b4e-6874-42c3-b555-a395fecb05f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:03.516067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-62828b4e-6874-42c3-b555-a395fecb05f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.246753 Dec 21 04:10:03.516861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 482/919] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:03 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:04.084039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-222b6755-f4f3-4112-ad4f-60ac05ffc75d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:04.085168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-222b6755-f4f3-4112-ad4f-60ac05ffc75d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:04.093732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-222b6755-f4f3-4112-ad4f-60ac05ffc75d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:04.094187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-222b6755-f4f3-4112-ad4f-60ac05ffc75d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:04.095598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-222b6755-f4f3-4112-ad4f-60ac05ffc75d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:04.096058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-222b6755-f4f3-4112-ad4f-60ac05ffc75d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:04.221066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-222b6755-f4f3-4112-ad4f-60ac05ffc75d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 33696 microversion: 2.1 time: 0.146571 Dec 21 04:10:04.221775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 438/920] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:10:04 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 33696 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:10:04.540103 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-03a92c02-4ecc-4903-9190-945ad6c70668 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:04.540766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-03a92c02-4ecc-4903-9190-945ad6c70668 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:04.549215 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03a92c02-4ecc-4903-9190-945ad6c70668 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:04.549718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03a92c02-4ecc-4903-9190-945ad6c70668 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:04.550533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03a92c02-4ecc-4903-9190-945ad6c70668 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:04.551045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03a92c02-4ecc-4903-9190-945ad6c70668 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:04.769083 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-03a92c02-4ecc-4903-9190-945ad6c70668 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:04.777848 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-03a92c02-4ecc-4903-9190-945ad6c70668 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.247409 Dec 21 04:10:04.778440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 483/921] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:04 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:05.240457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a321dc18-3ebb-45fc-be0f-29191c1d0074 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:05.241596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a321dc18-3ebb-45fc-be0f-29191c1d0074 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:05.250104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a321dc18-3ebb-45fc-be0f-29191c1d0074 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:05.251271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a321dc18-3ebb-45fc-be0f-29191c1d0074 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:05.252556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a321dc18-3ebb-45fc-be0f-29191c1d0074 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:05.253049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a321dc18-3ebb-45fc-be0f-29191c1d0074 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:05.383365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a321dc18-3ebb-45fc-be0f-29191c1d0074 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 34863 microversion: 2.1 time: 0.153320 Dec 21 04:10:05.383972 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 439/922] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:10:05 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 34863 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:10:05.801626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-53f2896f-312f-443c-a4fa-a2d450c37da1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:05.802304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-53f2896f-312f-443c-a4fa-a2d450c37da1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:05.810184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-53f2896f-312f-443c-a4fa-a2d450c37da1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:05.810693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-53f2896f-312f-443c-a4fa-a2d450c37da1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:05.811557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-53f2896f-312f-443c-a4fa-a2d450c37da1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:05.812048 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-53f2896f-312f-443c-a4fa-a2d450c37da1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:06.029335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-53f2896f-312f-443c-a4fa-a2d450c37da1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:06.039205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-53f2896f-312f-443c-a4fa-a2d450c37da1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.247184 Dec 21 04:10:06.039802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 484/923] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:05 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:06.401563 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fe613b72-74bd-4308-ab48-de89cedeb762 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:06.402700 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fe613b72-74bd-4308-ab48-de89cedeb762 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:06.411238 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe613b72-74bd-4308-ab48-de89cedeb762 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:06.411738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe613b72-74bd-4308-ab48-de89cedeb762 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:06.412572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe613b72-74bd-4308-ab48-de89cedeb762 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:06.413060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fe613b72-74bd-4308-ab48-de89cedeb762 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:06.536674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fe613b72-74bd-4308-ab48-de89cedeb762 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 35934 microversion: 2.1 time: 0.145132 Dec 21 04:10:06.537379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 440/924] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:10:06 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 35934 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:10:07.063336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-181f73a3-01c9-4663-9d80-c30c3ddc6ead tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:07.064005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-181f73a3-01c9-4663-9d80-c30c3ddc6ead tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:07.071940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-181f73a3-01c9-4663-9d80-c30c3ddc6ead tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:07.072449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-181f73a3-01c9-4663-9d80-c30c3ddc6ead tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:07.073284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-181f73a3-01c9-4663-9d80-c30c3ddc6ead tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:07.073780 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-181f73a3-01c9-4663-9d80-c30c3ddc6ead tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:07.292294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-181f73a3-01c9-4663-9d80-c30c3ddc6ead tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:07.301343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-181f73a3-01c9-4663-9d80-c30c3ddc6ead tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.247169 Dec 21 04:10:07.301940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 485/925] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:07 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:07.555233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4a0d2191-913f-48e2-823b-0340b9b7f4cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:07.556303 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4a0d2191-913f-48e2-823b-0340b9b7f4cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:07.564850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4a0d2191-913f-48e2-823b-0340b9b7f4cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:07.565351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4a0d2191-913f-48e2-823b-0340b9b7f4cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:07.566170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4a0d2191-913f-48e2-823b-0340b9b7f4cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:07.566659 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4a0d2191-913f-48e2-823b-0340b9b7f4cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:07.686602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4a0d2191-913f-48e2-823b-0340b9b7f4cb tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 37669 microversion: 2.1 time: 0.141055 Dec 21 04:10:07.687348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 441/926] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:10:07 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 37669 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:10:08.324678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d490c283-c1dc-4565-ba41-353abeb45ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:08.325348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d490c283-c1dc-4565-ba41-353abeb45ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:08.333958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d490c283-c1dc-4565-ba41-353abeb45ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:08.334456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d490c283-c1dc-4565-ba41-353abeb45ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:08.335309 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d490c283-c1dc-4565-ba41-353abeb45ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:08.335799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d490c283-c1dc-4565-ba41-353abeb45ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:08.554933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d490c283-c1dc-4565-ba41-353abeb45ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:08.564375 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d490c283-c1dc-4565-ba41-353abeb45ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.248823 Dec 21 04:10:08.564963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 486/927] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:08 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:08.705650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-251d10e5-4fcd-4309-91c8-b7090502b951 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:08.707029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-251d10e5-4fcd-4309-91c8-b7090502b951 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:08.715904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-251d10e5-4fcd-4309-91c8-b7090502b951 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:08.716415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-251d10e5-4fcd-4309-91c8-b7090502b951 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:08.717265 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-251d10e5-4fcd-4309-91c8-b7090502b951 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:08.717760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-251d10e5-4fcd-4309-91c8-b7090502b951 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:08.844582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-251d10e5-4fcd-4309-91c8-b7090502b951 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 38184 microversion: 2.1 time: 0.148820 Dec 21 04:10:08.845189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 442/928] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:10:08 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 38184 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:10:09.588187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b07d2009-4c45-4060-8e72-3d81325a4b1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:09.588849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b07d2009-4c45-4060-8e72-3d81325a4b1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:09.597454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b07d2009-4c45-4060-8e72-3d81325a4b1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:09.597958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b07d2009-4c45-4060-8e72-3d81325a4b1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:09.598777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b07d2009-4c45-4060-8e72-3d81325a4b1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:09.599293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b07d2009-4c45-4060-8e72-3d81325a4b1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:09.816691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b07d2009-4c45-4060-8e72-3d81325a4b1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:09.825777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b07d2009-4c45-4060-8e72-3d81325a4b1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.247175 Dec 21 04:10:09.826370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 487/929] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:09 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:09.863147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-41955d49-a9db-40f7-ae9a-19d6a777a225 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:09.864288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-41955d49-a9db-40f7-ae9a-19d6a777a225 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:09.873109 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41955d49-a9db-40f7-ae9a-19d6a777a225 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:09.873617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41955d49-a9db-40f7-ae9a-19d6a777a225 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:09.874456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41955d49-a9db-40f7-ae9a-19d6a777a225 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:09.874973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-41955d49-a9db-40f7-ae9a-19d6a777a225 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:09.978298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-41955d49-a9db-40f7-ae9a-19d6a777a225 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 38184 microversion: 2.1 time: 0.124655 Dec 21 04:10:09.978986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 443/930] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:10:09 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 38184 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:10:10.850420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c1c09d57-05a1-4d30-b067-b14fe2af97f3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:10.851053 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c1c09d57-05a1-4d30-b067-b14fe2af97f3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:10.858872 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1c09d57-05a1-4d30-b067-b14fe2af97f3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:10.859404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1c09d57-05a1-4d30-b067-b14fe2af97f3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:10.860897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1c09d57-05a1-4d30-b067-b14fe2af97f3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:10.861382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1c09d57-05a1-4d30-b067-b14fe2af97f3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:10.996936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b56134f4-daf3-421b-8bf8-2928297647ae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:10.998085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b56134f4-daf3-421b-8bf8-2928297647ae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:11.007095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b56134f4-daf3-421b-8bf8-2928297647ae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:11.007609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b56134f4-daf3-421b-8bf8-2928297647ae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:11.008472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b56134f4-daf3-421b-8bf8-2928297647ae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:11.008962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b56134f4-daf3-421b-8bf8-2928297647ae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:11.075739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c1c09d57-05a1-4d30-b067-b14fe2af97f3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:11.086006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c1c09d57-05a1-4d30-b067-b14fe2af97f3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.245517 Dec 21 04:10:11.086608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 488/931] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:10 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:11.112374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b56134f4-daf3-421b-8bf8-2928297647ae tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 38184 microversion: 2.1 time: 0.125181 Dec 21 04:10:11.113021 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 444/932] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:10:10 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 38184 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 21 04:10:12.111012 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5360c956-f29d-4752-9dcf-f6a338d781b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:12.111629 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5360c956-f29d-4752-9dcf-f6a338d781b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:12.119847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5360c956-f29d-4752-9dcf-f6a338d781b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:12.120359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5360c956-f29d-4752-9dcf-f6a338d781b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:12.121190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5360c956-f29d-4752-9dcf-f6a338d781b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:12.121683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5360c956-f29d-4752-9dcf-f6a338d781b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:12.131383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a0c1c785-6176-4aa4-9d34-55814b43c839 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:12.132536 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a0c1c785-6176-4aa4-9d34-55814b43c839 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:12.141294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0c1c785-6176-4aa4-9d34-55814b43c839 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:12.141806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0c1c785-6176-4aa4-9d34-55814b43c839 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:12.142640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0c1c785-6176-4aa4-9d34-55814b43c839 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:12.143169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0c1c785-6176-4aa4-9d34-55814b43c839 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:12.264225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a0c1c785-6176-4aa4-9d34-55814b43c839 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action" status: 200 len: 38311 microversion: 2.1 time: 0.142747 Dec 21 04:10:12.265361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 445/933] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:10:12 2020] POST /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/action => generated 38311 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 21 04:10:12.281138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-55d21137-bd16-4c90-b16c-994f0e36108d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:12.282580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-55d21137-bd16-4c90-b16c-994f0e36108d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:12.291727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55d21137-bd16-4c90-b16c-994f0e36108d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:12.292234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55d21137-bd16-4c90-b16c-994f0e36108d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:12.293084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55d21137-bd16-4c90-b16c-994f0e36108d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:12.293578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55d21137-bd16-4c90-b16c-994f0e36108d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:12.346206 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5360c956-f29d-4752-9dcf-f6a338d781b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:12.355241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5360c956-f29d-4752-9dcf-f6a338d781b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.253989 Dec 21 04:10:12.355858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 489/934] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:12 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:12.362073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-55d21137-bd16-4c90-b16c-994f0e36108d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/ips" status: 200 len: 146 microversion: 2.1 time: 0.090218 Dec 21 04:10:12.366515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 446/935] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Dec 21 04:10:12 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2/ips => generated 146 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:10:13.379151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b3c0dc26-52da-4b5f-b6ae-09a67c61f6f2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:13.379821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b3c0dc26-52da-4b5f-b6ae-09a67c61f6f2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:13.387783 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3c0dc26-52da-4b5f-b6ae-09a67c61f6f2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:13.388314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3c0dc26-52da-4b5f-b6ae-09a67c61f6f2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:13.389124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3c0dc26-52da-4b5f-b6ae-09a67c61f6f2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:13.389616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3c0dc26-52da-4b5f-b6ae-09a67c61f6f2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:13.643943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b3c0dc26-52da-4b5f-b6ae-09a67c61f6f2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:13.652735 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b3c0dc26-52da-4b5f-b6ae-09a67c61f6f2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.282954 Dec 21 04:10:13.653311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 490/936] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:13 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:14.676869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4defe670-55a3-4ac3-a3f6-21951a527bce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:14.677595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4defe670-55a3-4ac3-a3f6-21951a527bce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:14.685906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4defe670-55a3-4ac3-a3f6-21951a527bce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:14.686406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4defe670-55a3-4ac3-a3f6-21951a527bce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:14.688106 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4defe670-55a3-4ac3-a3f6-21951a527bce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:14.688810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4defe670-55a3-4ac3-a3f6-21951a527bce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:14.907928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4defe670-55a3-4ac3-a3f6-21951a527bce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:14.916958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4defe670-55a3-4ac3-a3f6-21951a527bce tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.249808 Dec 21 04:10:14.917610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 447/937] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:14 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:15.940176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8298a3ef-f6d9-4633-8a70-054015a65752 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:15.940835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8298a3ef-f6d9-4633-8a70-054015a65752 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:15.948719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8298a3ef-f6d9-4633-8a70-054015a65752 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:15.949222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8298a3ef-f6d9-4633-8a70-054015a65752 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:15.950044 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8298a3ef-f6d9-4633-8a70-054015a65752 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:15.950533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8298a3ef-f6d9-4633-8a70-054015a65752 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:16.166198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8298a3ef-f6d9-4633-8a70-054015a65752 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:16.175771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8298a3ef-f6d9-4633-8a70-054015a65752 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.244613 Dec 21 04:10:16.176358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 491/938] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:15 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:17.199488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-881cc78e-0f3d-479f-a28b-a47c124d32da tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:17.200154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-881cc78e-0f3d-479f-a28b-a47c124d32da tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:17.208568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-881cc78e-0f3d-479f-a28b-a47c124d32da tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:17.209081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-881cc78e-0f3d-479f-a28b-a47c124d32da tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:17.209922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-881cc78e-0f3d-479f-a28b-a47c124d32da tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:17.210415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-881cc78e-0f3d-479f-a28b-a47c124d32da tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:17.254463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c2dce176-6856-43eb-a57b-ad9aee92088d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1211628095"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:17.255200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c2dce176-6856-43eb-a57b-ad9aee92088d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:17.269337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c2dce176-6856-43eb-a57b-ad9aee92088d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:17.269840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c2dce176-6856-43eb-a57b-ad9aee92088d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:17.270687 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c2dce176-6856-43eb-a57b-ad9aee92088d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:17.271203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c2dce176-6856-43eb-a57b-ad9aee92088d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:17.448467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-881cc78e-0f3d-479f-a28b-a47c124d32da tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:17.459381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-881cc78e-0f3d-479f-a28b-a47c124d32da tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.268876 Dec 21 04:10:17.460753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 448/939] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:17 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:17.506213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.network.security_group_api [None req-c2dce176-6856-43eb-a57b-ad9aee92088d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Removing security group fe7d78e4-796e-4202-a68c-7a0163cad230 from port a286529e-ec58-4881-9bf1-0a30fd25f4af Dec 21 04:10:18.203029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c2dce176-6856-43eb-a57b-ad9aee92088d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "POST /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/action" status: 202 len: 0 microversion: 2.1 time: 0.960833 Dec 21 04:10:18.208817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 492/940] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:10:17 2020] POST /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/action => generated 0 bytes in 967 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 21 04:10:18.217365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-760dafaf-f174-4b9f-8c05-014203c7c71d req-cf0e0d21-4b07-429b-bd7c-53ecb98119ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa828a0-c810-48fe-8ea0-866c312aeb98", "tag": "a286529e-ec58-4881-9bf1-0a30fd25f4af"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:18.218876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1a3de236-c44f-4cd6-86aa-80bf08b6ecec tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '.version_select at 0x7f2bb855a950>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:18.224127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:18.224127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:10:18.233486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-760dafaf-f174-4b9f-8c05-014203c7c71d req-cf0e0d21-4b07-429b-bd7c-53ecb98119ab service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:18.233989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-760dafaf-f174-4b9f-8c05-014203c7c71d req-cf0e0d21-4b07-429b-bd7c-53ecb98119ab service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:18.254946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-760dafaf-f174-4b9f-8c05-014203c7c71d req-cf0e0d21-4b07-429b-bd7c-53ecb98119ab service nova] Creating event network-changed:a286529e-ec58-4881-9bf1-0a30fd25f4af for instance daa828a0-c810-48fe-8ea0-866c312aeb98 on hv-cinder-73306 Dec 21 04:10:18.260429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-760dafaf-f174-4b9f-8c05-014203c7c71d req-cf0e0d21-4b07-429b-bd7c-53ecb98119ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052056 Dec 21 04:10:18.261530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 449/941] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:10:18 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:10:18.493076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f262faf1-a9f9-4a92-ba33-412d624d34b2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:18.493848 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f262faf1-a9f9-4a92-ba33-412d624d34b2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:18.516083 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f262faf1-a9f9-4a92-ba33-412d624d34b2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:18.519526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f262faf1-a9f9-4a92-ba33-412d624d34b2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:18.520748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f262faf1-a9f9-4a92-ba33-412d624d34b2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:18.522214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f262faf1-a9f9-4a92-ba33-412d624d34b2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:18.528469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1a3de236-c44f-4cd6-86aa-80bf08b6ecec tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/fe7d78e4-796e-4202-a68c-7a0163cad230" status: 202 len: 0 microversion: 2.1 time: 0.318449 Dec 21 04:10:18.529105 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 493/942] 10.222.0.16 () {58 vars in 1262 bytes} [Mon Dec 21 04:10:18 2020] DELETE /compute/v2.1/os-security-groups/fe7d78e4-796e-4202-a68c-7a0163cad230 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:10:18.543496 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cbbbf66b-51cb-4305-95d1-ab8730f49ad2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '.version_select at 0x7f2bb855aae8>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:18.935600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f262faf1-a9f9-4a92-ba33-412d624d34b2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:18.944960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f262faf1-a9f9-4a92-ba33-412d624d34b2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.470781 Dec 21 04:10:18.945721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 450/943] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:18 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:19.062098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cbbbf66b-51cb-4305-95d1-ab8730f49ad2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:19.071348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbbbf66b-51cb-4305-95d1-ab8730f49ad2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:19.071868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbbbf66b-51cb-4305-95d1-ab8730f49ad2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:19.072764 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbbbf66b-51cb-4305-95d1-ab8730f49ad2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:19.073258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbbbf66b-51cb-4305-95d1-ab8730f49ad2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:19.135248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbbbf66b-51cb-4305-95d1-ab8730f49ad2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Acquired lock "refresh_cache-daa828a0-c810-48fe-8ea0-866c312aeb98" {{(pid=94299) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 21 04:10:19.969125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c1685644-f268-45ec-9f72-5db05f2a691a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:19.969849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c1685644-f268-45ec-9f72-5db05f2a691a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:19.977924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1685644-f268-45ec-9f72-5db05f2a691a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:19.978432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1685644-f268-45ec-9f72-5db05f2a691a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:19.979301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1685644-f268-45ec-9f72-5db05f2a691a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:19.979794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1685644-f268-45ec-9f72-5db05f2a691a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:20.212199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c1685644-f268-45ec-9f72-5db05f2a691a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:20.221523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c1685644-f268-45ec-9f72-5db05f2a691a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.261571 Dec 21 04:10:20.222126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 451/944] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:19 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:10:21.039524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-cbbbf66b-51cb-4305-95d1-ab8730f49ad2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Building network info cache for instance {{(pid=94299) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 21 04:10:21.053812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-efea5bc7-d825-407f-ae67-6ddc0bba46e8 req-a633f01e-66c2-472a-942b-0c5f55c6c26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa828a0-c810-48fe-8ea0-866c312aeb98", "tag": "a286529e-ec58-4881-9bf1-0a30fd25f4af"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:10:21.060733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:21.060733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:10:21.070491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-efea5bc7-d825-407f-ae67-6ddc0bba46e8 req-a633f01e-66c2-472a-942b-0c5f55c6c26a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:21.071912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-efea5bc7-d825-407f-ae67-6ddc0bba46e8 req-a633f01e-66c2-472a-942b-0c5f55c6c26a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:21.090686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-efea5bc7-d825-407f-ae67-6ddc0bba46e8 req-a633f01e-66c2-472a-942b-0c5f55c6c26a service nova] Creating event network-changed:a286529e-ec58-4881-9bf1-0a30fd25f4af for instance daa828a0-c810-48fe-8ea0-866c312aeb98 on hv-cinder-73306 Dec 21 04:10:21.097385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-efea5bc7-d825-407f-ae67-6ddc0bba46e8 req-a633f01e-66c2-472a-942b-0c5f55c6c26a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052993 Dec 21 04:10:21.098303 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 452/945] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:10:21 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:10:21.246371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ec59e254-f576-4f17-85c2-a000f4a29c8f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:21.249222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ec59e254-f576-4f17-85c2-a000f4a29c8f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:21.268853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec59e254-f576-4f17-85c2-a000f4a29c8f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:21.281956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec59e254-f576-4f17-85c2-a000f4a29c8f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:21.283360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec59e254-f576-4f17-85c2-a000f4a29c8f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:21.284086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ec59e254-f576-4f17-85c2-a000f4a29c8f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:21.704601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ec59e254-f576-4f17-85c2-a000f4a29c8f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:21.715801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ec59e254-f576-4f17-85c2-a000f4a29c8f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.479145 Dec 21 04:10:21.717339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 453/946] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:21 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:21.913663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-cbbbf66b-51cb-4305-95d1-ab8730f49ad2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Updating instance_info_cache with network_info: [{"id": "a286529e-ec58-4881-9bf1-0a30fd25f4af", "address": "fa:16:3e:81:40:84", "network": {"id": "78dad1cc-329d-4b16-a292-99bbc6a23af7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1496133927-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c854b1b3076d4532ac6b8813b4df1ab6", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapa286529e-ec", "ovs_interfaceid": "a286529e-ec58-4881-9bf1-0a30fd25f4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94299) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 21 04:10:21.924306 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbbbf66b-51cb-4305-95d1-ab8730f49ad2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Releasing lock "refresh_cache-daa828a0-c810-48fe-8ea0-866c312aeb98" {{(pid=94299) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 21 04:10:21.925341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cbbbf66b-51cb-4305-95d1-ab8730f49ad2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/01a47abf-e1a5-4ed0-a72a-a692899b163d" status: 202 len: 0 microversion: 2.1 time: 3.391113 Dec 21 04:10:21.926237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 494/947] 10.222.0.16 () {58 vars in 1253 bytes} [Mon Dec 21 04:10:18 2020] DELETE /compute/v2.1/os-floating-ips/01a47abf-e1a5-4ed0-a72a-a692899b163d => generated 0 bytes in 3393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:10:21.941273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-93950fe4-720c-4c62-b439-ff9989f8ba6c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:21.942065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-93950fe4-720c-4c62-b439-ff9989f8ba6c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:21.950122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93950fe4-720c-4c62-b439-ff9989f8ba6c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:21.950729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93950fe4-720c-4c62-b439-ff9989f8ba6c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:21.951679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93950fe4-720c-4c62-b439-ff9989f8ba6c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:21.952385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93950fe4-720c-4c62-b439-ff9989f8ba6c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:22.253089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-93950fe4-720c-4c62-b439-ff9989f8ba6c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "DELETE /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/os-volume_attachments/1e143391-15c7-44a4-a604-43b10f13945e" status: 202 len: 0 microversion: 2.1 time: 0.321042 Dec 21 04:10:22.253749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 454/948] 10.222.0.16 () {58 vars in 1406 bytes} [Mon Dec 21 04:10:21 2020] DELETE /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/os-volume_attachments/1e143391-15c7-44a4-a604-43b10f13945e => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:10:22.739648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0daadecf-3614-4783-9f9e-ca5037c70dc5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:22.740574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0daadecf-3614-4783-9f9e-ca5037c70dc5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:22.748601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0daadecf-3614-4783-9f9e-ca5037c70dc5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:22.749117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0daadecf-3614-4783-9f9e-ca5037c70dc5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:22.750605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0daadecf-3614-4783-9f9e-ca5037c70dc5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:22.751504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0daadecf-3614-4783-9f9e-ca5037c70dc5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:22.979302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0daadecf-3614-4783-9f9e-ca5037c70dc5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:22.989163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0daadecf-3614-4783-9f9e-ca5037c70dc5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.259412 Dec 21 04:10:22.999697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 495/949] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:22 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:24.013110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5f792bdf-5c11-431d-8c04-202ece4d92a2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:24.013870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5f792bdf-5c11-431d-8c04-202ece4d92a2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:24.022755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5f792bdf-5c11-431d-8c04-202ece4d92a2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:24.023319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5f792bdf-5c11-431d-8c04-202ece4d92a2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:24.024152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5f792bdf-5c11-431d-8c04-202ece4d92a2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:24.024648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5f792bdf-5c11-431d-8c04-202ece4d92a2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:24.245133 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5f792bdf-5c11-431d-8c04-202ece4d92a2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:24.255364 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5f792bdf-5c11-431d-8c04-202ece4d92a2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.251988 Dec 21 04:10:24.255952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 455/950] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:24 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:25.278802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4568f7fa-890a-42ca-b683-c655f4e2e241 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:25.279486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4568f7fa-890a-42ca-b683-c655f4e2e241 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:25.292934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4568f7fa-890a-42ca-b683-c655f4e2e241 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:25.293438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4568f7fa-890a-42ca-b683-c655f4e2e241 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:25.294270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4568f7fa-890a-42ca-b683-c655f4e2e241 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:25.294757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4568f7fa-890a-42ca-b683-c655f4e2e241 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:25.646509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4568f7fa-890a-42ca-b683-c655f4e2e241 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:25.655328 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4568f7fa-890a-42ca-b683-c655f4e2e241 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1573 microversion: 2.1 time: 0.385680 Dec 21 04:10:25.655921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 496/951] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:25 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1573 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:26.679452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0f709925-d393-4e3f-ba64-a9f146afae83 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:26.680173 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0f709925-d393-4e3f-ba64-a9f146afae83 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:26.688550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f709925-d393-4e3f-ba64-a9f146afae83 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:26.689047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f709925-d393-4e3f-ba64-a9f146afae83 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:26.689874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f709925-d393-4e3f-ba64-a9f146afae83 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:26.690366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f709925-d393-4e3f-ba64-a9f146afae83 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:26.910820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0f709925-d393-4e3f-ba64-a9f146afae83 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:26.919765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0f709925-d393-4e3f-ba64-a9f146afae83 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249539 Dec 21 04:10:26.920543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 456/952] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:26 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:27.943433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f54ae769-e700-4668-b63b-76c144d01ff4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:27.944111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f54ae769-e700-4668-b63b-76c144d01ff4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:27.952070 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f54ae769-e700-4668-b63b-76c144d01ff4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:27.952579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f54ae769-e700-4668-b63b-76c144d01ff4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:27.953425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f54ae769-e700-4668-b63b-76c144d01ff4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:27.953907 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f54ae769-e700-4668-b63b-76c144d01ff4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:28.169393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f54ae769-e700-4668-b63b-76c144d01ff4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:28.178822 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f54ae769-e700-4668-b63b-76c144d01ff4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.244630 Dec 21 04:10:28.179449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 497/953] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:27 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:29.202050 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-15c082eb-611b-4c07-8f47-a24532277778 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:29.202711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-15c082eb-611b-4c07-8f47-a24532277778 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:29.210914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15c082eb-611b-4c07-8f47-a24532277778 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:29.211437 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15c082eb-611b-4c07-8f47-a24532277778 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:29.212354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15c082eb-611b-4c07-8f47-a24532277778 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:29.212743 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15c082eb-611b-4c07-8f47-a24532277778 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:29.432308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-15c082eb-611b-4c07-8f47-a24532277778 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:29.441367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-15c082eb-611b-4c07-8f47-a24532277778 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248485 Dec 21 04:10:29.441945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 457/954] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:29 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:30.465235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7f36bffa-7631-4a53-9864-240b2fdeea37 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:30.465907 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7f36bffa-7631-4a53-9864-240b2fdeea37 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:30.473845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f36bffa-7631-4a53-9864-240b2fdeea37 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:30.474353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f36bffa-7631-4a53-9864-240b2fdeea37 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:30.475218 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f36bffa-7631-4a53-9864-240b2fdeea37 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:30.475715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f36bffa-7631-4a53-9864-240b2fdeea37 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:30.702274 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7f36bffa-7631-4a53-9864-240b2fdeea37 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:30.711060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7f36bffa-7631-4a53-9864-240b2fdeea37 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.254768 Dec 21 04:10:30.711645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 498/955] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:30 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:31.735711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d2c2a0ef-6db8-4800-bf40-d4805150946b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:31.736381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d2c2a0ef-6db8-4800-bf40-d4805150946b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:31.744521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d2c2a0ef-6db8-4800-bf40-d4805150946b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:31.745032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d2c2a0ef-6db8-4800-bf40-d4805150946b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:31.745867 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d2c2a0ef-6db8-4800-bf40-d4805150946b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:31.746361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d2c2a0ef-6db8-4800-bf40-d4805150946b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:31.961312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d2c2a0ef-6db8-4800-bf40-d4805150946b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:31.971090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d2c2a0ef-6db8-4800-bf40-d4805150946b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245814 Dec 21 04:10:31.971684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 458/956] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:31 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:32.995221 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-26aa37ff-df74-4bb2-9e0c-bc29c6d7bd59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:32.995891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-26aa37ff-df74-4bb2-9e0c-bc29c6d7bd59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:33.004403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26aa37ff-df74-4bb2-9e0c-bc29c6d7bd59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:33.004926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26aa37ff-df74-4bb2-9e0c-bc29c6d7bd59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:33.005739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26aa37ff-df74-4bb2-9e0c-bc29c6d7bd59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:33.006229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26aa37ff-df74-4bb2-9e0c-bc29c6d7bd59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:33.226111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-26aa37ff-df74-4bb2-9e0c-bc29c6d7bd59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:33.235587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-26aa37ff-df74-4bb2-9e0c-bc29c6d7bd59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249787 Dec 21 04:10:33.236173 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 499/957] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:32 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:34.259614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-70ac8df0-46be-4b21-ad94-f4453fd61eec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:34.260276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-70ac8df0-46be-4b21-ad94-f4453fd61eec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:34.268608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70ac8df0-46be-4b21-ad94-f4453fd61eec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:34.269117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70ac8df0-46be-4b21-ad94-f4453fd61eec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:34.269949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70ac8df0-46be-4b21-ad94-f4453fd61eec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:34.270439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-70ac8df0-46be-4b21-ad94-f4453fd61eec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:34.489874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-70ac8df0-46be-4b21-ad94-f4453fd61eec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:34.499116 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-70ac8df0-46be-4b21-ad94-f4453fd61eec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249070 Dec 21 04:10:34.499708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 459/958] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:34 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:35.523462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-22619714-6f84-4f64-afdc-e2389cd70ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:35.524134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-22619714-6f84-4f64-afdc-e2389cd70ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:35.532555 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-22619714-6f84-4f64-afdc-e2389cd70ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:35.533065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-22619714-6f84-4f64-afdc-e2389cd70ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:35.533901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-22619714-6f84-4f64-afdc-e2389cd70ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:35.534399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-22619714-6f84-4f64-afdc-e2389cd70ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:35.752542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-22619714-6f84-4f64-afdc-e2389cd70ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:35.771582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-22619714-6f84-4f64-afdc-e2389cd70ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247588 Dec 21 04:10:35.771582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 500/959] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:35 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:36.785918 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-429c2ff3-ff00-4a88-ac8b-c5a0f4ab6471 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:36.786583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-429c2ff3-ff00-4a88-ac8b-c5a0f4ab6471 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:36.794470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-429c2ff3-ff00-4a88-ac8b-c5a0f4ab6471 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:36.795039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-429c2ff3-ff00-4a88-ac8b-c5a0f4ab6471 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:36.795880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-429c2ff3-ff00-4a88-ac8b-c5a0f4ab6471 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:36.796890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-429c2ff3-ff00-4a88-ac8b-c5a0f4ab6471 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:37.154254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-429c2ff3-ff00-4a88-ac8b-c5a0f4ab6471 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:37.164081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-429c2ff3-ff00-4a88-ac8b-c5a0f4ab6471 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.387407 Dec 21 04:10:37.164682 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 460/960] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:36 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:38.188024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-88b6efcb-9078-4347-b9b8-b2b9628c9007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:38.188694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-88b6efcb-9078-4347-b9b8-b2b9628c9007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:38.196537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88b6efcb-9078-4347-b9b8-b2b9628c9007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:38.197049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88b6efcb-9078-4347-b9b8-b2b9628c9007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:38.197882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88b6efcb-9078-4347-b9b8-b2b9628c9007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:38.198373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88b6efcb-9078-4347-b9b8-b2b9628c9007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:38.421925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-88b6efcb-9078-4347-b9b8-b2b9628c9007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:38.430951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-88b6efcb-9078-4347-b9b8-b2b9628c9007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.252043 Dec 21 04:10:38.431588 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 501/961] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:38 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:39.455154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6ddcb1e2-e646-4545-9074-e1ab70b5fc9c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:39.455813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6ddcb1e2-e646-4545-9074-e1ab70b5fc9c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:39.463744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ddcb1e2-e646-4545-9074-e1ab70b5fc9c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:39.464251 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ddcb1e2-e646-4545-9074-e1ab70b5fc9c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:39.465082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ddcb1e2-e646-4545-9074-e1ab70b5fc9c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:39.465574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ddcb1e2-e646-4545-9074-e1ab70b5fc9c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:39.684525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6ddcb1e2-e646-4545-9074-e1ab70b5fc9c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:39.693328 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6ddcb1e2-e646-4545-9074-e1ab70b5fc9c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247366 Dec 21 04:10:39.693913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 461/962] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:39 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:40.717122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e3576227-a604-4769-afa2-f5fe32d6946f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:40.717724 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e3576227-a604-4769-afa2-f5fe32d6946f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:40.725594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3576227-a604-4769-afa2-f5fe32d6946f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:40.726100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3576227-a604-4769-afa2-f5fe32d6946f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:40.726932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3576227-a604-4769-afa2-f5fe32d6946f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:40.727439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e3576227-a604-4769-afa2-f5fe32d6946f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:40.944814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e3576227-a604-4769-afa2-f5fe32d6946f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:40.954445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e3576227-a604-4769-afa2-f5fe32d6946f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246435 Dec 21 04:10:40.955052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 502/963] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:40 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:41.978595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a700ba11-5691-4138-8ce1-68d877555578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:41.979279 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a700ba11-5691-4138-8ce1-68d877555578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:41.987158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a700ba11-5691-4138-8ce1-68d877555578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:41.987781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a700ba11-5691-4138-8ce1-68d877555578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:41.988612 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a700ba11-5691-4138-8ce1-68d877555578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:41.989124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a700ba11-5691-4138-8ce1-68d877555578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:42.209647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a700ba11-5691-4138-8ce1-68d877555578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:42.218626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a700ba11-5691-4138-8ce1-68d877555578 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249081 Dec 21 04:10:42.219248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 462/964] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:41 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:43.248148 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-61f13e76-91e9-4b4f-a6b2-583009a83002 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:43.248821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-61f13e76-91e9-4b4f-a6b2-583009a83002 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:43.257226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-61f13e76-91e9-4b4f-a6b2-583009a83002 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:43.257712 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-61f13e76-91e9-4b4f-a6b2-583009a83002 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:43.258544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-61f13e76-91e9-4b4f-a6b2-583009a83002 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:43.259084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-61f13e76-91e9-4b4f-a6b2-583009a83002 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:43.472855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-61f13e76-91e9-4b4f-a6b2-583009a83002 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:43.481934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-61f13e76-91e9-4b4f-a6b2-583009a83002 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249446 Dec 21 04:10:43.482509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 503/965] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:43 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:44.505422 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-023074b8-1021-418b-b7cb-ce57128d1658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:44.506086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-023074b8-1021-418b-b7cb-ce57128d1658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:44.514009 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-023074b8-1021-418b-b7cb-ce57128d1658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:44.514514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-023074b8-1021-418b-b7cb-ce57128d1658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:44.515389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-023074b8-1021-418b-b7cb-ce57128d1658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:44.516017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-023074b8-1021-418b-b7cb-ce57128d1658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:44.731639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-023074b8-1021-418b-b7cb-ce57128d1658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:44.741574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-023074b8-1021-418b-b7cb-ce57128d1658 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245226 Dec 21 04:10:44.742170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 463/966] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:44 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:45.765001 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b020759b-7b73-4cc4-be71-be2ede3a4cef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:45.765783 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b020759b-7b73-4cc4-be71-be2ede3a4cef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:45.773455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b020759b-7b73-4cc4-be71-be2ede3a4cef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:45.773956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b020759b-7b73-4cc4-be71-be2ede3a4cef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:45.774773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b020759b-7b73-4cc4-be71-be2ede3a4cef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:45.775285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b020759b-7b73-4cc4-be71-be2ede3a4cef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:45.995167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b020759b-7b73-4cc4-be71-be2ede3a4cef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:46.004170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b020759b-7b73-4cc4-be71-be2ede3a4cef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248245 Dec 21 04:10:46.004761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 504/967] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:45 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:47.027502 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0ea43f04-1211-4376-895c-ae25e7b188a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:47.028116 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0ea43f04-1211-4376-895c-ae25e7b188a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:47.036745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ea43f04-1211-4376-895c-ae25e7b188a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:47.037261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ea43f04-1211-4376-895c-ae25e7b188a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:47.038099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ea43f04-1211-4376-895c-ae25e7b188a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:47.038593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ea43f04-1211-4376-895c-ae25e7b188a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:47.262762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0ea43f04-1211-4376-895c-ae25e7b188a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:47.271881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0ea43f04-1211-4376-895c-ae25e7b188a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.253729 Dec 21 04:10:47.272451 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 464/968] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:47 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:48.295222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fef1c67c-3cb9-4ac8-8b85-fcd33d58c93f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:48.295895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fef1c67c-3cb9-4ac8-8b85-fcd33d58c93f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:48.304255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fef1c67c-3cb9-4ac8-8b85-fcd33d58c93f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:48.304765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fef1c67c-3cb9-4ac8-8b85-fcd33d58c93f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:48.305607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fef1c67c-3cb9-4ac8-8b85-fcd33d58c93f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:48.306105 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fef1c67c-3cb9-4ac8-8b85-fcd33d58c93f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:48.544733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fef1c67c-3cb9-4ac8-8b85-fcd33d58c93f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:48.554355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fef1c67c-3cb9-4ac8-8b85-fcd33d58c93f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.268610 Dec 21 04:10:48.555229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 505/969] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:48 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:49.579731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d9856cd8-e7d5-4062-9ff1-f74063ca038b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:49.580391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d9856cd8-e7d5-4062-9ff1-f74063ca038b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:49.588271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d9856cd8-e7d5-4062-9ff1-f74063ca038b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:49.588778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d9856cd8-e7d5-4062-9ff1-f74063ca038b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:49.589607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d9856cd8-e7d5-4062-9ff1-f74063ca038b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:49.590100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d9856cd8-e7d5-4062-9ff1-f74063ca038b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:49.809057 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d9856cd8-e7d5-4062-9ff1-f74063ca038b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:49.818365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d9856cd8-e7d5-4062-9ff1-f74063ca038b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248446 Dec 21 04:10:49.818969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 465/970] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:49 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:50.842358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-984ad007-015c-415b-8ad6-345df08f027c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:50.843741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-984ad007-015c-415b-8ad6-345df08f027c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:50.851580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-984ad007-015c-415b-8ad6-345df08f027c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:50.852093 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-984ad007-015c-415b-8ad6-345df08f027c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:50.852925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-984ad007-015c-415b-8ad6-345df08f027c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:50.853419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-984ad007-015c-415b-8ad6-345df08f027c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:51.063967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-984ad007-015c-415b-8ad6-345df08f027c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:51.072786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-984ad007-015c-415b-8ad6-345df08f027c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.239591 Dec 21 04:10:51.073383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 506/971] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:50 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:52.096998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7d4bc082-e495-4837-a977-70bc89df2ca3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:52.097656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7d4bc082-e495-4837-a977-70bc89df2ca3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:52.105583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d4bc082-e495-4837-a977-70bc89df2ca3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:52.106089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d4bc082-e495-4837-a977-70bc89df2ca3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:52.106928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d4bc082-e495-4837-a977-70bc89df2ca3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:52.107423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d4bc082-e495-4837-a977-70bc89df2ca3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:52.325714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7d4bc082-e495-4837-a977-70bc89df2ca3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:52.335499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7d4bc082-e495-4837-a977-70bc89df2ca3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248025 Dec 21 04:10:52.336084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 466/972] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:52 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:53.359505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ccbe38eb-2821-4af4-9e1d-decfe5e24f62 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:53.360175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ccbe38eb-2821-4af4-9e1d-decfe5e24f62 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:53.368326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ccbe38eb-2821-4af4-9e1d-decfe5e24f62 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:53.368828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ccbe38eb-2821-4af4-9e1d-decfe5e24f62 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:53.369647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ccbe38eb-2821-4af4-9e1d-decfe5e24f62 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:53.370136 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ccbe38eb-2821-4af4-9e1d-decfe5e24f62 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:53.598238 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ccbe38eb-2821-4af4-9e1d-decfe5e24f62 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:53.607388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ccbe38eb-2821-4af4-9e1d-decfe5e24f62 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.257323 Dec 21 04:10:53.607926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 507/973] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:53 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:54.632102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b7384d5a-fac8-4606-bb86-cb2a57e8fcbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:54.632766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b7384d5a-fac8-4606-bb86-cb2a57e8fcbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:54.640723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7384d5a-fac8-4606-bb86-cb2a57e8fcbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:54.641227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7384d5a-fac8-4606-bb86-cb2a57e8fcbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:54.642058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7384d5a-fac8-4606-bb86-cb2a57e8fcbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:54.642549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7384d5a-fac8-4606-bb86-cb2a57e8fcbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:54.862953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b7384d5a-fac8-4606-bb86-cb2a57e8fcbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:54.872116 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b7384d5a-fac8-4606-bb86-cb2a57e8fcbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.250340 Dec 21 04:10:54.872710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 467/974] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:54 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:55.899954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-05a01e0f-61cf-474c-b3a9-f1c0930efd9f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:55.900629 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-05a01e0f-61cf-474c-b3a9-f1c0930efd9f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:55.909465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-05a01e0f-61cf-474c-b3a9-f1c0930efd9f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:55.909979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-05a01e0f-61cf-474c-b3a9-f1c0930efd9f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:55.910830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-05a01e0f-61cf-474c-b3a9-f1c0930efd9f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:55.911353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-05a01e0f-61cf-474c-b3a9-f1c0930efd9f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:56.135294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-05a01e0f-61cf-474c-b3a9-f1c0930efd9f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:56.144366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-05a01e0f-61cf-474c-b3a9-f1c0930efd9f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.258645 Dec 21 04:10:56.144963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 508/975] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:55 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:57.166800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-de4072b8-b57d-414b-871d-d8aa52ca522a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:57.167489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-de4072b8-b57d-414b-871d-d8aa52ca522a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:57.175471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de4072b8-b57d-414b-871d-d8aa52ca522a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:57.175974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de4072b8-b57d-414b-871d-d8aa52ca522a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:57.176811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de4072b8-b57d-414b-871d-d8aa52ca522a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:57.177299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de4072b8-b57d-414b-871d-d8aa52ca522a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:57.401384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-de4072b8-b57d-414b-871d-d8aa52ca522a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:57.410563 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-de4072b8-b57d-414b-871d-d8aa52ca522a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.252770 Dec 21 04:10:57.411180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 468/976] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:57 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:10:58.433861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-618bd9ef-f22a-4503-9cc5-8104e80c1db6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:58.434524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-618bd9ef-f22a-4503-9cc5-8104e80c1db6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:58.442453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-618bd9ef-f22a-4503-9cc5-8104e80c1db6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:58.442984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-618bd9ef-f22a-4503-9cc5-8104e80c1db6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:58.443816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-618bd9ef-f22a-4503-9cc5-8104e80c1db6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:58.444306 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-618bd9ef-f22a-4503-9cc5-8104e80c1db6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:58.656353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-618bd9ef-f22a-4503-9cc5-8104e80c1db6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:58.665426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-618bd9ef-f22a-4503-9cc5-8104e80c1db6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.240653 Dec 21 04:10:58.666028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 509/977] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:58 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:10:59.688742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-10d3cdd9-be5e-442f-a727-8e4d4331ad16 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:10:59.689327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-10d3cdd9-be5e-442f-a727-8e4d4331ad16 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:10:59.697229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10d3cdd9-be5e-442f-a727-8e4d4331ad16 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:59.697743 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10d3cdd9-be5e-442f-a727-8e4d4331ad16 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:59.698575 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10d3cdd9-be5e-442f-a727-8e4d4331ad16 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:10:59.699125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-10d3cdd9-be5e-442f-a727-8e4d4331ad16 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:10:59.915632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-10d3cdd9-be5e-442f-a727-8e4d4331ad16 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:10:59.924568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-10d3cdd9-be5e-442f-a727-8e4d4331ad16 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.244916 Dec 21 04:10:59.925164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 469/978] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:10:59 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:00.947905 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f301db72-08cd-416e-a76f-e3d78153229d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:00.948476 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f301db72-08cd-416e-a76f-e3d78153229d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:00.956435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f301db72-08cd-416e-a76f-e3d78153229d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:00.956945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f301db72-08cd-416e-a76f-e3d78153229d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:00.957771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f301db72-08cd-416e-a76f-e3d78153229d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:00.958264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f301db72-08cd-416e-a76f-e3d78153229d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:01.389067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f301db72-08cd-416e-a76f-e3d78153229d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:01.398522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f301db72-08cd-416e-a76f-e3d78153229d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.459928 Dec 21 04:11:01.399151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 510/979] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:00 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:02.423457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-832b6568-e0b9-4519-8a72-0aa8961b52b1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:02.424132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-832b6568-e0b9-4519-8a72-0aa8961b52b1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:02.432066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-832b6568-e0b9-4519-8a72-0aa8961b52b1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:02.432570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-832b6568-e0b9-4519-8a72-0aa8961b52b1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:02.433402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-832b6568-e0b9-4519-8a72-0aa8961b52b1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:02.433896 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-832b6568-e0b9-4519-8a72-0aa8961b52b1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:02.653810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-832b6568-e0b9-4519-8a72-0aa8961b52b1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:02.662629 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-832b6568-e0b9-4519-8a72-0aa8961b52b1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249183 Dec 21 04:11:02.667933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 470/980] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:02 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:03.686971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-100598c3-e66c-46cf-84a7-2a1494768dde tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:03.687646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-100598c3-e66c-46cf-84a7-2a1494768dde tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:03.695559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-100598c3-e66c-46cf-84a7-2a1494768dde tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:03.696062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-100598c3-e66c-46cf-84a7-2a1494768dde tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:03.696885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-100598c3-e66c-46cf-84a7-2a1494768dde tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:03.697368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-100598c3-e66c-46cf-84a7-2a1494768dde tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:03.917891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-100598c3-e66c-46cf-84a7-2a1494768dde tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:03.927526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-100598c3-e66c-46cf-84a7-2a1494768dde tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.250304 Dec 21 04:11:03.928118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 511/981] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:03 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:04.951311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0396b624-6ebf-4707-9f84-1bc422f3ec2c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:04.952615 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0396b624-6ebf-4707-9f84-1bc422f3ec2c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:04.960642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0396b624-6ebf-4707-9f84-1bc422f3ec2c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:04.961194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0396b624-6ebf-4707-9f84-1bc422f3ec2c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:04.962035 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0396b624-6ebf-4707-9f84-1bc422f3ec2c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:04.962534 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0396b624-6ebf-4707-9f84-1bc422f3ec2c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:05.180660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0396b624-6ebf-4707-9f84-1bc422f3ec2c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:05.190149 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0396b624-6ebf-4707-9f84-1bc422f3ec2c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248245 Dec 21 04:11:05.190741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 471/982] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:04 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:11:06.213758 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-50c6a924-8a8d-40d7-a143-b24c9f74a02f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:06.214421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-50c6a924-8a8d-40d7-a143-b24c9f74a02f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:06.222381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50c6a924-8a8d-40d7-a143-b24c9f74a02f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:06.222882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50c6a924-8a8d-40d7-a143-b24c9f74a02f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:06.223788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50c6a924-8a8d-40d7-a143-b24c9f74a02f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:06.224277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50c6a924-8a8d-40d7-a143-b24c9f74a02f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:06.440868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-50c6a924-8a8d-40d7-a143-b24c9f74a02f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:06.449867 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-50c6a924-8a8d-40d7-a143-b24c9f74a02f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245047 Dec 21 04:11:06.450651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 512/983] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:06 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:07.475207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-241d778f-d7f2-454a-847a-ca804f9dc35d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:07.475800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-241d778f-d7f2-454a-847a-ca804f9dc35d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:07.483772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-241d778f-d7f2-454a-847a-ca804f9dc35d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:07.484277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-241d778f-d7f2-454a-847a-ca804f9dc35d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:07.485106 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-241d778f-d7f2-454a-847a-ca804f9dc35d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:07.485600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-241d778f-d7f2-454a-847a-ca804f9dc35d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:07.702810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-241d778f-d7f2-454a-847a-ca804f9dc35d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:07.711913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-241d778f-d7f2-454a-847a-ca804f9dc35d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246794 Dec 21 04:11:07.712779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 472/984] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:07 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:08.735629 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0f11ab95-5946-41a0-8277-5156037f6541 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:08.736293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0f11ab95-5946-41a0-8277-5156037f6541 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:08.744403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f11ab95-5946-41a0-8277-5156037f6541 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:08.744853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f11ab95-5946-41a0-8277-5156037f6541 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:08.745676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f11ab95-5946-41a0-8277-5156037f6541 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:08.746161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0f11ab95-5946-41a0-8277-5156037f6541 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:08.962569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0f11ab95-5946-41a0-8277-5156037f6541 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:08.972221 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0f11ab95-5946-41a0-8277-5156037f6541 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246356 Dec 21 04:11:08.972827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 513/985] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:08 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:09.996013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2f8cc5c8-b16b-47e8-ab6d-1bfe25581f9e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:09.996675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2f8cc5c8-b16b-47e8-ab6d-1bfe25581f9e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:10.004640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2f8cc5c8-b16b-47e8-ab6d-1bfe25581f9e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:10.005123 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2f8cc5c8-b16b-47e8-ab6d-1bfe25581f9e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:10.005955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2f8cc5c8-b16b-47e8-ab6d-1bfe25581f9e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:10.006446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2f8cc5c8-b16b-47e8-ab6d-1bfe25581f9e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:10.223338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2f8cc5c8-b16b-47e8-ab6d-1bfe25581f9e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:10.232217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2f8cc5c8-b16b-47e8-ab6d-1bfe25581f9e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245615 Dec 21 04:11:10.232810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 473/986] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:09 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:11.258370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ffff4c7e-7a28-4fc5-8e1f-5a6e209a0add tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:11.259144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ffff4c7e-7a28-4fc5-8e1f-5a6e209a0add tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:11.267651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ffff4c7e-7a28-4fc5-8e1f-5a6e209a0add tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:11.268161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ffff4c7e-7a28-4fc5-8e1f-5a6e209a0add tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:11.268994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ffff4c7e-7a28-4fc5-8e1f-5a6e209a0add tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:11.269487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ffff4c7e-7a28-4fc5-8e1f-5a6e209a0add tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:11.494605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ffff4c7e-7a28-4fc5-8e1f-5a6e209a0add tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:11.504445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ffff4c7e-7a28-4fc5-8e1f-5a6e209a0add tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.256681 Dec 21 04:11:11.505049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 514/987] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:11 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:11:12.529478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-82077b7a-3053-4c1b-b135-17c1c31a6f7e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:12.531492 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-82077b7a-3053-4c1b-b135-17c1c31a6f7e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:12.540433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-82077b7a-3053-4c1b-b135-17c1c31a6f7e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:12.541083 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-82077b7a-3053-4c1b-b135-17c1c31a6f7e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:12.541790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-82077b7a-3053-4c1b-b135-17c1c31a6f7e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:12.542283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-82077b7a-3053-4c1b-b135-17c1c31a6f7e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:12.786138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-82077b7a-3053-4c1b-b135-17c1c31a6f7e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:12.795298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-82077b7a-3053-4c1b-b135-17c1c31a6f7e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.275241 Dec 21 04:11:12.796077 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 474/988] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:12 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:13.821086 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a69c580a-21cc-4ee3-8e89-b6609e7be516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:13.821841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a69c580a-21cc-4ee3-8e89-b6609e7be516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:13.830340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a69c580a-21cc-4ee3-8e89-b6609e7be516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:13.830850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a69c580a-21cc-4ee3-8e89-b6609e7be516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:13.831691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a69c580a-21cc-4ee3-8e89-b6609e7be516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:13.832175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a69c580a-21cc-4ee3-8e89-b6609e7be516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:14.047466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a69c580a-21cc-4ee3-8e89-b6609e7be516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:14.056386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a69c580a-21cc-4ee3-8e89-b6609e7be516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245293 Dec 21 04:11:14.056984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 515/989] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:13 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:15.080225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b7d8162b-6775-4d17-b13c-62e331d4ba3f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:15.080891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b7d8162b-6775-4d17-b13c-62e331d4ba3f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:15.088808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7d8162b-6775-4d17-b13c-62e331d4ba3f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:15.089317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7d8162b-6775-4d17-b13c-62e331d4ba3f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:15.090146 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7d8162b-6775-4d17-b13c-62e331d4ba3f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:15.090639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b7d8162b-6775-4d17-b13c-62e331d4ba3f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:15.307328 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b7d8162b-6775-4d17-b13c-62e331d4ba3f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:15.316799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b7d8162b-6775-4d17-b13c-62e331d4ba3f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246341 Dec 21 04:11:15.317392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 475/990] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:15 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:16.340587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e4ba2bcd-d64e-4477-a311-d2fc10db02ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:16.341256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e4ba2bcd-d64e-4477-a311-d2fc10db02ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:16.349752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4ba2bcd-d64e-4477-a311-d2fc10db02ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:16.350250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4ba2bcd-d64e-4477-a311-d2fc10db02ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:16.351095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4ba2bcd-d64e-4477-a311-d2fc10db02ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:16.351583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4ba2bcd-d64e-4477-a311-d2fc10db02ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:16.566965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e4ba2bcd-d64e-4477-a311-d2fc10db02ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:16.576080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e4ba2bcd-d64e-4477-a311-d2fc10db02ec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.244560 Dec 21 04:11:16.577206 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 516/991] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:16 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:17.601111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9b11cbb4-5317-4efe-89b5-7f655a892a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:17.601760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9b11cbb4-5317-4efe-89b5-7f655a892a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:17.610228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9b11cbb4-5317-4efe-89b5-7f655a892a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:17.610735 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9b11cbb4-5317-4efe-89b5-7f655a892a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:17.611589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9b11cbb4-5317-4efe-89b5-7f655a892a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:17.612082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9b11cbb4-5317-4efe-89b5-7f655a892a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:17.828644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9b11cbb4-5317-4efe-89b5-7f655a892a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:17.837656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9b11cbb4-5317-4efe-89b5-7f655a892a44 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246295 Dec 21 04:11:17.843832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 476/992] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:17 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:18.862475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2456315b-47df-4581-8902-7b8f8c9f2405 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:18.863175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2456315b-47df-4581-8902-7b8f8c9f2405 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:18.871421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2456315b-47df-4581-8902-7b8f8c9f2405 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:18.871930 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2456315b-47df-4581-8902-7b8f8c9f2405 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:18.872752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2456315b-47df-4581-8902-7b8f8c9f2405 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:18.873390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2456315b-47df-4581-8902-7b8f8c9f2405 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:19.094944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2456315b-47df-4581-8902-7b8f8c9f2405 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:19.103902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2456315b-47df-4581-8902-7b8f8c9f2405 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.251602 Dec 21 04:11:19.104633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 517/993] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:18 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:20.129011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8f57303d-a7dd-47d5-af5a-89f66b591a0d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:20.129661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8f57303d-a7dd-47d5-af5a-89f66b591a0d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:20.137419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f57303d-a7dd-47d5-af5a-89f66b591a0d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:20.137921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f57303d-a7dd-47d5-af5a-89f66b591a0d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:20.138786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f57303d-a7dd-47d5-af5a-89f66b591a0d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:20.139440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f57303d-a7dd-47d5-af5a-89f66b591a0d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:20.361713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8f57303d-a7dd-47d5-af5a-89f66b591a0d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:20.370942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8f57303d-a7dd-47d5-af5a-89f66b591a0d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.251622 Dec 21 04:11:20.371839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 477/994] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:20 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:21.395175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f3ef6827-f11d-4940-805b-c9ae616d2d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:21.395839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f3ef6827-f11d-4940-805b-c9ae616d2d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:21.403707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3ef6827-f11d-4940-805b-c9ae616d2d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:21.404214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3ef6827-f11d-4940-805b-c9ae616d2d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:21.405197 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3ef6827-f11d-4940-805b-c9ae616d2d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:21.405683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3ef6827-f11d-4940-805b-c9ae616d2d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:21.632325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f3ef6827-f11d-4940-805b-c9ae616d2d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:21.641342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f3ef6827-f11d-4940-805b-c9ae616d2d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.256127 Dec 21 04:11:21.641986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 518/995] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:21 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:22.664976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a623213a-0b40-4386-8901-3501693bb563 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:22.665581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a623213a-0b40-4386-8901-3501693bb563 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:22.673485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a623213a-0b40-4386-8901-3501693bb563 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:22.673986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a623213a-0b40-4386-8901-3501693bb563 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:22.674809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a623213a-0b40-4386-8901-3501693bb563 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:22.675323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a623213a-0b40-4386-8901-3501693bb563 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:22.891715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a623213a-0b40-4386-8901-3501693bb563 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:22.900547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a623213a-0b40-4386-8901-3501693bb563 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.244797 Dec 21 04:11:22.901153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 478/996] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:22 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:11:23.924493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-87119494-eb6a-4f5d-a42d-12b7a20f49ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:23.925174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-87119494-eb6a-4f5d-a42d-12b7a20f49ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:23.933208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87119494-eb6a-4f5d-a42d-12b7a20f49ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:23.933723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87119494-eb6a-4f5d-a42d-12b7a20f49ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:23.934554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87119494-eb6a-4f5d-a42d-12b7a20f49ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:23.935079 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87119494-eb6a-4f5d-a42d-12b7a20f49ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:24.152334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-87119494-eb6a-4f5d-a42d-12b7a20f49ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:24.162515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-87119494-eb6a-4f5d-a42d-12b7a20f49ac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247826 Dec 21 04:11:24.163195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 519/997] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:23 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:25.185914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a36a6300-5a2f-4552-b8c9-1a3c5a0e0d7b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:25.186576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a36a6300-5a2f-4552-b8c9-1a3c5a0e0d7b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:25.194466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a36a6300-5a2f-4552-b8c9-1a3c5a0e0d7b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:25.194994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a36a6300-5a2f-4552-b8c9-1a3c5a0e0d7b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:25.195817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a36a6300-5a2f-4552-b8c9-1a3c5a0e0d7b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:25.196305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a36a6300-5a2f-4552-b8c9-1a3c5a0e0d7b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:25.412444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a36a6300-5a2f-4552-b8c9-1a3c5a0e0d7b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:25.421691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a36a6300-5a2f-4552-b8c9-1a3c5a0e0d7b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.244937 Dec 21 04:11:25.422284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 479/998] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:25 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:26.445430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-95dc3271-6b78-45a0-9a51-07cd2bebde66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:26.446029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-95dc3271-6b78-45a0-9a51-07cd2bebde66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:26.454035 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-95dc3271-6b78-45a0-9a51-07cd2bebde66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:26.454543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-95dc3271-6b78-45a0-9a51-07cd2bebde66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:26.455404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-95dc3271-6b78-45a0-9a51-07cd2bebde66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:26.455891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-95dc3271-6b78-45a0-9a51-07cd2bebde66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:26.683974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-95dc3271-6b78-45a0-9a51-07cd2bebde66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:26.692851 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-95dc3271-6b78-45a0-9a51-07cd2bebde66 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.256705 Dec 21 04:11:26.693430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 520/999] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:26 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:27.715473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-03d39414-4b36-42fc-8bfb-298fdfdc0fb0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:27.716133 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-03d39414-4b36-42fc-8bfb-298fdfdc0fb0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:27.724103 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03d39414-4b36-42fc-8bfb-298fdfdc0fb0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:27.724607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03d39414-4b36-42fc-8bfb-298fdfdc0fb0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:27.725429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03d39414-4b36-42fc-8bfb-298fdfdc0fb0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:27.725917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03d39414-4b36-42fc-8bfb-298fdfdc0fb0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:27.954936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-03d39414-4b36-42fc-8bfb-298fdfdc0fb0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:27.963860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-03d39414-4b36-42fc-8bfb-298fdfdc0fb0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.257281 Dec 21 04:11:27.964433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 480/1000] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:27 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:28.988710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-804307f3-c9fb-4711-8478-1a5f466a8a76 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:28.989527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-804307f3-c9fb-4711-8478-1a5f466a8a76 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:28.997688 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-804307f3-c9fb-4711-8478-1a5f466a8a76 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:28.998204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-804307f3-c9fb-4711-8478-1a5f466a8a76 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:28.999070 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-804307f3-c9fb-4711-8478-1a5f466a8a76 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:29.000420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-804307f3-c9fb-4711-8478-1a5f466a8a76 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:29.215307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-804307f3-c9fb-4711-8478-1a5f466a8a76 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:29.224525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-804307f3-c9fb-4711-8478-1a5f466a8a76 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245770 Dec 21 04:11:29.225117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 521/1001] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:28 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:30.248549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9fd7b0d1-de64-48de-8dfc-7d4f08424279 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:30.249942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9fd7b0d1-de64-48de-8dfc-7d4f08424279 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:30.258448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9fd7b0d1-de64-48de-8dfc-7d4f08424279 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:30.258980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9fd7b0d1-de64-48de-8dfc-7d4f08424279 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:30.259808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9fd7b0d1-de64-48de-8dfc-7d4f08424279 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:30.260296 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9fd7b0d1-de64-48de-8dfc-7d4f08424279 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:30.479484 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9fd7b0d1-de64-48de-8dfc-7d4f08424279 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:30.489152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9fd7b0d1-de64-48de-8dfc-7d4f08424279 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249910 Dec 21 04:11:30.489752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 481/1002] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:30 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:31.513683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-93750d34-db79-4f9c-9649-db74c51cb3c5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:31.514344 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-93750d34-db79-4f9c-9649-db74c51cb3c5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:31.522776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93750d34-db79-4f9c-9649-db74c51cb3c5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:31.523384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93750d34-db79-4f9c-9649-db74c51cb3c5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:31.524210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93750d34-db79-4f9c-9649-db74c51cb3c5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:31.524697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93750d34-db79-4f9c-9649-db74c51cb3c5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:31.740874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-93750d34-db79-4f9c-9649-db74c51cb3c5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:31.750177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-93750d34-db79-4f9c-9649-db74c51cb3c5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245433 Dec 21 04:11:31.750769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 522/1003] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:31 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:32.773865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-edc80e73-0d3f-4e5a-9bcb-2e8edfd54aa2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:32.774531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-edc80e73-0d3f-4e5a-9bcb-2e8edfd54aa2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:32.782384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-edc80e73-0d3f-4e5a-9bcb-2e8edfd54aa2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:32.782890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-edc80e73-0d3f-4e5a-9bcb-2e8edfd54aa2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:32.783754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-edc80e73-0d3f-4e5a-9bcb-2e8edfd54aa2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:32.784242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-edc80e73-0d3f-4e5a-9bcb-2e8edfd54aa2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:32.995912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-edc80e73-0d3f-4e5a-9bcb-2e8edfd54aa2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:33.005764 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-edc80e73-0d3f-4e5a-9bcb-2e8edfd54aa2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.241498 Dec 21 04:11:33.006365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 482/1004] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:32 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:34.028615 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8f928ce9-dd92-4acf-8238-77672d0a955d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:34.029280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8f928ce9-dd92-4acf-8238-77672d0a955d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:34.037340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f928ce9-dd92-4acf-8238-77672d0a955d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:34.037859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f928ce9-dd92-4acf-8238-77672d0a955d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:34.038692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f928ce9-dd92-4acf-8238-77672d0a955d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:34.039217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f928ce9-dd92-4acf-8238-77672d0a955d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:34.260504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8f928ce9-dd92-4acf-8238-77672d0a955d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:34.269734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8f928ce9-dd92-4acf-8238-77672d0a955d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.250427 Dec 21 04:11:34.270562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 523/1005] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:34 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:35.293035 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-06f342e8-f378-447c-8ebb-c6b8756da4e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:35.293693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-06f342e8-f378-447c-8ebb-c6b8756da4e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:35.301597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-06f342e8-f378-447c-8ebb-c6b8756da4e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:35.302099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-06f342e8-f378-447c-8ebb-c6b8756da4e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:35.302987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-06f342e8-f378-447c-8ebb-c6b8756da4e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:35.303477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-06f342e8-f378-447c-8ebb-c6b8756da4e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:35.534365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-06f342e8-f378-447c-8ebb-c6b8756da4e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:35.544131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-06f342e8-f378-447c-8ebb-c6b8756da4e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.260002 Dec 21 04:11:35.544674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 483/1006] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:35 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:36.567464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a8117b07-d37b-4c89-9c06-dc092fd993ba tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:36.568137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a8117b07-d37b-4c89-9c06-dc092fd993ba tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:36.576099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8117b07-d37b-4c89-9c06-dc092fd993ba tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:36.576614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8117b07-d37b-4c89-9c06-dc092fd993ba tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:36.578211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8117b07-d37b-4c89-9c06-dc092fd993ba tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:36.578712 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8117b07-d37b-4c89-9c06-dc092fd993ba tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:36.801932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a8117b07-d37b-4c89-9c06-dc092fd993ba tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:36.810961 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a8117b07-d37b-4c89-9c06-dc092fd993ba tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.253160 Dec 21 04:11:36.812088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 524/1007] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:36 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:37.835483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e629c62d-f21f-41f5-a26f-5e3594969788 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:37.836147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e629c62d-f21f-41f5-a26f-5e3594969788 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:37.845383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e629c62d-f21f-41f5-a26f-5e3594969788 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:37.845946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e629c62d-f21f-41f5-a26f-5e3594969788 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:37.846797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e629c62d-f21f-41f5-a26f-5e3594969788 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:37.847399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e629c62d-f21f-41f5-a26f-5e3594969788 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:38.065741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e629c62d-f21f-41f5-a26f-5e3594969788 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:38.074672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e629c62d-f21f-41f5-a26f-5e3594969788 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249011 Dec 21 04:11:38.075308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 484/1008] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:37 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:39.099460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6299b09c-c03a-46e1-bf99-c155e16b71e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:39.100060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6299b09c-c03a-46e1-bf99-c155e16b71e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:39.107868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6299b09c-c03a-46e1-bf99-c155e16b71e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:39.109254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6299b09c-c03a-46e1-bf99-c155e16b71e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:39.110140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6299b09c-c03a-46e1-bf99-c155e16b71e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:39.110640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6299b09c-c03a-46e1-bf99-c155e16b71e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:39.324859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6299b09c-c03a-46e1-bf99-c155e16b71e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:39.333897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6299b09c-c03a-46e1-bf99-c155e16b71e1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.244491 Dec 21 04:11:39.334492 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 525/1009] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:39 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:40.357853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-56749775-af88-43f0-9471-64014ba7f343 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:40.358568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-56749775-af88-43f0-9471-64014ba7f343 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:40.366625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56749775-af88-43f0-9471-64014ba7f343 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:40.367184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56749775-af88-43f0-9471-64014ba7f343 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:40.368010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56749775-af88-43f0-9471-64014ba7f343 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:40.368498 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56749775-af88-43f0-9471-64014ba7f343 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:40.583159 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-56749775-af88-43f0-9471-64014ba7f343 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:40.592448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-56749775-af88-43f0-9471-64014ba7f343 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.243826 Dec 21 04:11:40.593048 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 485/1010] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:40 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:41.616805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f3fa686b-6586-4847-bc73-4416a37e2a02 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:41.617469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f3fa686b-6586-4847-bc73-4416a37e2a02 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:41.625596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3fa686b-6586-4847-bc73-4416a37e2a02 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:41.626046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3fa686b-6586-4847-bc73-4416a37e2a02 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:41.626866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3fa686b-6586-4847-bc73-4416a37e2a02 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:41.627377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f3fa686b-6586-4847-bc73-4416a37e2a02 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:41.845390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f3fa686b-6586-4847-bc73-4416a37e2a02 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:41.854348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f3fa686b-6586-4847-bc73-4416a37e2a02 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247619 Dec 21 04:11:41.854953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 526/1011] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:41 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:42.879033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3e8c1369-dffb-416b-b87b-569b40dd5a7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:42.879715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3e8c1369-dffb-416b-b87b-569b40dd5a7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:42.887650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3e8c1369-dffb-416b-b87b-569b40dd5a7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:42.888165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3e8c1369-dffb-416b-b87b-569b40dd5a7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:42.889002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3e8c1369-dffb-416b-b87b-569b40dd5a7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:42.889751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3e8c1369-dffb-416b-b87b-569b40dd5a7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:43.254570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3e8c1369-dffb-416b-b87b-569b40dd5a7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:43.265397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3e8c1369-dffb-416b-b87b-569b40dd5a7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.394920 Dec 21 04:11:43.266144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 486/1012] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:42 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:44.290250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bad2c3bd-81c8-454b-a90b-527e8f7994ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:44.290916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bad2c3bd-81c8-454b-a90b-527e8f7994ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:44.299376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bad2c3bd-81c8-454b-a90b-527e8f7994ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:44.299890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bad2c3bd-81c8-454b-a90b-527e8f7994ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:44.300732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bad2c3bd-81c8-454b-a90b-527e8f7994ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:44.301226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bad2c3bd-81c8-454b-a90b-527e8f7994ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:44.520468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bad2c3bd-81c8-454b-a90b-527e8f7994ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:44.529267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bad2c3bd-81c8-454b-a90b-527e8f7994ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248166 Dec 21 04:11:44.530377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 527/1013] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:44 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:45.554273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9496b7b7-afb6-4f15-b843-e873366b2f67 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:45.554971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9496b7b7-afb6-4f15-b843-e873366b2f67 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:45.563501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9496b7b7-afb6-4f15-b843-e873366b2f67 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:45.564019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9496b7b7-afb6-4f15-b843-e873366b2f67 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:45.564858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9496b7b7-afb6-4f15-b843-e873366b2f67 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:45.565360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9496b7b7-afb6-4f15-b843-e873366b2f67 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:45.987741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9496b7b7-afb6-4f15-b843-e873366b2f67 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:45.996900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9496b7b7-afb6-4f15-b843-e873366b2f67 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.452153 Dec 21 04:11:45.997494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 487/1014] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:45 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:47.020211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-21c727fb-fc8f-4175-ad32-6e36a9e9a80b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:47.020881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-21c727fb-fc8f-4175-ad32-6e36a9e9a80b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:47.028797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-21c727fb-fc8f-4175-ad32-6e36a9e9a80b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:47.029309 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-21c727fb-fc8f-4175-ad32-6e36a9e9a80b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:47.030179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-21c727fb-fc8f-4175-ad32-6e36a9e9a80b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:47.030674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-21c727fb-fc8f-4175-ad32-6e36a9e9a80b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:47.243422 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-21c727fb-fc8f-4175-ad32-6e36a9e9a80b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:47.253432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-21c727fb-fc8f-4175-ad32-6e36a9e9a80b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.242513 Dec 21 04:11:47.254030 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 528/1015] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:47 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:48.276817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5efcf751-1006-4236-9a2e-6997101e7e88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:48.277471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5efcf751-1006-4236-9a2e-6997101e7e88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:48.285723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5efcf751-1006-4236-9a2e-6997101e7e88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:48.286227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5efcf751-1006-4236-9a2e-6997101e7e88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:48.287111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5efcf751-1006-4236-9a2e-6997101e7e88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:48.287603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5efcf751-1006-4236-9a2e-6997101e7e88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:48.514125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5efcf751-1006-4236-9a2e-6997101e7e88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:48.523248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5efcf751-1006-4236-9a2e-6997101e7e88 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.255463 Dec 21 04:11:48.523840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 488/1016] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:48 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:49.546932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-48cce7d4-9cd4-4ef2-b018-338bcb632ab7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:49.547603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-48cce7d4-9cd4-4ef2-b018-338bcb632ab7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:49.555481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-48cce7d4-9cd4-4ef2-b018-338bcb632ab7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:49.555985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-48cce7d4-9cd4-4ef2-b018-338bcb632ab7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:49.556805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-48cce7d4-9cd4-4ef2-b018-338bcb632ab7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:49.557292 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-48cce7d4-9cd4-4ef2-b018-338bcb632ab7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:49.785568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-48cce7d4-9cd4-4ef2-b018-338bcb632ab7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:49.794515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-48cce7d4-9cd4-4ef2-b018-338bcb632ab7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.257115 Dec 21 04:11:49.795174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 529/1017] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:49 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:50.817775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-148d14ef-b103-4293-b0cf-b4ee5fbd9ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:50.818447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-148d14ef-b103-4293-b0cf-b4ee5fbd9ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:50.826402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-148d14ef-b103-4293-b0cf-b4ee5fbd9ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:50.827705 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-148d14ef-b103-4293-b0cf-b4ee5fbd9ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:50.829003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-148d14ef-b103-4293-b0cf-b4ee5fbd9ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:50.829111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-148d14ef-b103-4293-b0cf-b4ee5fbd9ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:51.061635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-148d14ef-b103-4293-b0cf-b4ee5fbd9ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:51.070545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-148d14ef-b103-4293-b0cf-b4ee5fbd9ad0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.261797 Dec 21 04:11:51.071158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 489/1018] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:50 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:52.094400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0cc58684-3c8e-4f9d-a890-118761db17bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:52.095208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0cc58684-3c8e-4f9d-a890-118761db17bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:52.103292 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0cc58684-3c8e-4f9d-a890-118761db17bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:52.103886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0cc58684-3c8e-4f9d-a890-118761db17bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:52.104809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0cc58684-3c8e-4f9d-a890-118761db17bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:52.105419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0cc58684-3c8e-4f9d-a890-118761db17bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:52.332340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0cc58684-3c8e-4f9d-a890-118761db17bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:52.341220 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0cc58684-3c8e-4f9d-a890-118761db17bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.256519 Dec 21 04:11:52.341815 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 530/1019] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:52 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:53.364851 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f50e5a67-79f9-4f0f-99a7-722a5ab4c359 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:53.365809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f50e5a67-79f9-4f0f-99a7-722a5ab4c359 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:53.374394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f50e5a67-79f9-4f0f-99a7-722a5ab4c359 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:53.374922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f50e5a67-79f9-4f0f-99a7-722a5ab4c359 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:53.375745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f50e5a67-79f9-4f0f-99a7-722a5ab4c359 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:53.376231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f50e5a67-79f9-4f0f-99a7-722a5ab4c359 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:53.598666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f50e5a67-79f9-4f0f-99a7-722a5ab4c359 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:53.607444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f50e5a67-79f9-4f0f-99a7-722a5ab4c359 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.251972 Dec 21 04:11:53.608265 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 490/1020] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:53 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:54.633864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-19b27532-0cf7-4cd1-9ebb-a80f50d3f7e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:54.634524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-19b27532-0cf7-4cd1-9ebb-a80f50d3f7e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:54.643022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19b27532-0cf7-4cd1-9ebb-a80f50d3f7e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:54.643541 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19b27532-0cf7-4cd1-9ebb-a80f50d3f7e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:54.644389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19b27532-0cf7-4cd1-9ebb-a80f50d3f7e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:54.644894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19b27532-0cf7-4cd1-9ebb-a80f50d3f7e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:54.858718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-19b27532-0cf7-4cd1-9ebb-a80f50d3f7e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:54.867860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-19b27532-0cf7-4cd1-9ebb-a80f50d3f7e8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.243007 Dec 21 04:11:54.868454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 531/1021] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:54 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:55.891698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7d6e8f87-e932-470a-8a8e-34493e6f1fe6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:55.892355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7d6e8f87-e932-470a-8a8e-34493e6f1fe6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:55.900509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d6e8f87-e932-470a-8a8e-34493e6f1fe6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:55.901018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d6e8f87-e932-470a-8a8e-34493e6f1fe6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:55.901846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d6e8f87-e932-470a-8a8e-34493e6f1fe6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:55.902334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7d6e8f87-e932-470a-8a8e-34493e6f1fe6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:56.120209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7d6e8f87-e932-470a-8a8e-34493e6f1fe6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:56.129155 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7d6e8f87-e932-470a-8a8e-34493e6f1fe6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246752 Dec 21 04:11:56.129742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 491/1022] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:55 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:57.153157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-020bc363-db3f-4ab5-b002-86fb6ec8e445 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:57.153720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-020bc363-db3f-4ab5-b002-86fb6ec8e445 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:57.162118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-020bc363-db3f-4ab5-b002-86fb6ec8e445 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:57.162622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-020bc363-db3f-4ab5-b002-86fb6ec8e445 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:57.163473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-020bc363-db3f-4ab5-b002-86fb6ec8e445 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:57.163958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-020bc363-db3f-4ab5-b002-86fb6ec8e445 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:57.389481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-020bc363-db3f-4ab5-b002-86fb6ec8e445 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:57.398628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-020bc363-db3f-4ab5-b002-86fb6ec8e445 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.254737 Dec 21 04:11:57.399394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 532/1023] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:57 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:58.423810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b776e9aa-d4e9-43eb-993d-2ea67b3b4413 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:58.424477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b776e9aa-d4e9-43eb-993d-2ea67b3b4413 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:58.432390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b776e9aa-d4e9-43eb-993d-2ea67b3b4413 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:58.432900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b776e9aa-d4e9-43eb-993d-2ea67b3b4413 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:58.433737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b776e9aa-d4e9-43eb-993d-2ea67b3b4413 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:58.434228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b776e9aa-d4e9-43eb-993d-2ea67b3b4413 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:58.655967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b776e9aa-d4e9-43eb-993d-2ea67b3b4413 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:58.668047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b776e9aa-d4e9-43eb-993d-2ea67b3b4413 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.254196 Dec 21 04:11:58.668817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 492/1024] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:58 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:11:59.692370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fbf74985-3edd-4993-85fc-a1391c194433 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:11:59.693039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fbf74985-3edd-4993-85fc-a1391c194433 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:11:59.700978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbf74985-3edd-4993-85fc-a1391c194433 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:59.702089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbf74985-3edd-4993-85fc-a1391c194433 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:59.702951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbf74985-3edd-4993-85fc-a1391c194433 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:11:59.703440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbf74985-3edd-4993-85fc-a1391c194433 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:11:59.938166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fbf74985-3edd-4993-85fc-a1391c194433 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:11:59.946994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fbf74985-3edd-4993-85fc-a1391c194433 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.263840 Dec 21 04:11:59.947583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 533/1025] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:11:59 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:00.971392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f001e08a-d97e-4a32-b516-576169626b38 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:00.972067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f001e08a-d97e-4a32-b516-576169626b38 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:00.979954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f001e08a-d97e-4a32-b516-576169626b38 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:00.980450 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f001e08a-d97e-4a32-b516-576169626b38 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:00.981287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f001e08a-d97e-4a32-b516-576169626b38 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:00.981781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f001e08a-d97e-4a32-b516-576169626b38 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:01.199023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f001e08a-d97e-4a32-b516-576169626b38 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:01.208535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f001e08a-d97e-4a32-b516-576169626b38 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246803 Dec 21 04:12:01.209167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 493/1026] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:00 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:02.232019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cd482e48-1f85-4290-b6be-c4914616e1a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:02.233298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cd482e48-1f85-4290-b6be-c4914616e1a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:02.241458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cd482e48-1f85-4290-b6be-c4914616e1a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:02.241963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cd482e48-1f85-4290-b6be-c4914616e1a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:02.242789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cd482e48-1f85-4290-b6be-c4914616e1a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:02.243304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cd482e48-1f85-4290-b6be-c4914616e1a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:02.462038 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cd482e48-1f85-4290-b6be-c4914616e1a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:02.471976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cd482e48-1f85-4290-b6be-c4914616e1a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249091 Dec 21 04:12:02.472583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 534/1027] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:02 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:03.495322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1a5cb888-0490-4b7d-894a-609e5719aa86 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:03.495982 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1a5cb888-0490-4b7d-894a-609e5719aa86 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:03.504962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a5cb888-0490-4b7d-894a-609e5719aa86 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:03.505484 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a5cb888-0490-4b7d-894a-609e5719aa86 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:03.506339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a5cb888-0490-4b7d-894a-609e5719aa86 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:03.506838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a5cb888-0490-4b7d-894a-609e5719aa86 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:03.729183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1a5cb888-0490-4b7d-894a-609e5719aa86 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:03.738222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1a5cb888-0490-4b7d-894a-609e5719aa86 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.252469 Dec 21 04:12:03.738820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 494/1028] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:03 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:04.761641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-18115676-91ee-4743-9d87-0da5276ff475 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:04.762305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-18115676-91ee-4743-9d87-0da5276ff475 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:04.770422 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18115676-91ee-4743-9d87-0da5276ff475 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:04.770954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18115676-91ee-4743-9d87-0da5276ff475 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:04.771787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18115676-91ee-4743-9d87-0da5276ff475 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:04.772280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18115676-91ee-4743-9d87-0da5276ff475 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:04.992484 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-18115676-91ee-4743-9d87-0da5276ff475 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:05.003703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-18115676-91ee-4743-9d87-0da5276ff475 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.251104 Dec 21 04:12:05.014636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 535/1029] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:04 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:06.027900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c7c07970-28ed-470f-b139-a6329d8a929c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:06.028552 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c7c07970-28ed-470f-b139-a6329d8a929c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:06.036802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7c07970-28ed-470f-b139-a6329d8a929c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:06.037319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7c07970-28ed-470f-b139-a6329d8a929c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:06.038158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7c07970-28ed-470f-b139-a6329d8a929c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:06.038652 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7c07970-28ed-470f-b139-a6329d8a929c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:06.259185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c7c07970-28ed-470f-b139-a6329d8a929c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:06.268066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c7c07970-28ed-470f-b139-a6329d8a929c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249548 Dec 21 04:12:06.268659 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 495/1030] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:06 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:07.199348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:12:07.199821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:12:07 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:12:07.290779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0bf502c4-ad17-44e3-ae19-4e24c9a74d59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:07.291414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0bf502c4-ad17-44e3-ae19-4e24c9a74d59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:07.300511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0bf502c4-ad17-44e3-ae19-4e24c9a74d59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:07.301023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0bf502c4-ad17-44e3-ae19-4e24c9a74d59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:07.301859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0bf502c4-ad17-44e3-ae19-4e24c9a74d59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:07.302353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0bf502c4-ad17-44e3-ae19-4e24c9a74d59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:07.538949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0bf502c4-ad17-44e3-ae19-4e24c9a74d59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:07.548880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0bf502c4-ad17-44e3-ae19-4e24c9a74d59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.266972 Dec 21 04:12:07.549434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 536/1031] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:07 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:08.572932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8cd97ed7-31ba-4d60-9065-6271fe48df4a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:08.573580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8cd97ed7-31ba-4d60-9065-6271fe48df4a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:08.582542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8cd97ed7-31ba-4d60-9065-6271fe48df4a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:08.583115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8cd97ed7-31ba-4d60-9065-6271fe48df4a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:08.583972 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8cd97ed7-31ba-4d60-9065-6271fe48df4a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:08.584449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8cd97ed7-31ba-4d60-9065-6271fe48df4a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:08.805897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8cd97ed7-31ba-4d60-9065-6271fe48df4a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:08.815438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8cd97ed7-31ba-4d60-9065-6271fe48df4a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.251828 Dec 21 04:12:08.816020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 496/1032] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:08 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:09.838678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6b442f00-a031-425b-8bf3-ecb6a66983bc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:09.839369 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6b442f00-a031-425b-8bf3-ecb6a66983bc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:09.847501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6b442f00-a031-425b-8bf3-ecb6a66983bc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:09.848006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6b442f00-a031-425b-8bf3-ecb6a66983bc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:09.848828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6b442f00-a031-425b-8bf3-ecb6a66983bc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:09.849312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6b442f00-a031-425b-8bf3-ecb6a66983bc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:10.064689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6b442f00-a031-425b-8bf3-ecb6a66983bc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:10.073696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6b442f00-a031-425b-8bf3-ecb6a66983bc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.244015 Dec 21 04:12:10.074367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 537/1033] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:09 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:11.097791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-479ab148-8387-494c-873e-13011331ae63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:11.098452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-479ab148-8387-494c-873e-13011331ae63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:11.106368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-479ab148-8387-494c-873e-13011331ae63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:11.106869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-479ab148-8387-494c-873e-13011331ae63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:11.108240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-479ab148-8387-494c-873e-13011331ae63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:11.108731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-479ab148-8387-494c-873e-13011331ae63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:11.328013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-479ab148-8387-494c-873e-13011331ae63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:11.336888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-479ab148-8387-494c-873e-13011331ae63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248470 Dec 21 04:12:11.337485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 497/1034] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:11 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:12.360163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-18f94b46-f2bd-460b-8857-a0d206e5c1d5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:12.360821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-18f94b46-f2bd-460b-8857-a0d206e5c1d5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:12.368880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18f94b46-f2bd-460b-8857-a0d206e5c1d5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:12.369384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18f94b46-f2bd-460b-8857-a0d206e5c1d5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:12.370203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18f94b46-f2bd-460b-8857-a0d206e5c1d5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:12.370690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18f94b46-f2bd-460b-8857-a0d206e5c1d5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:12.593881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-18f94b46-f2bd-460b-8857-a0d206e5c1d5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:12.602708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-18f94b46-f2bd-460b-8857-a0d206e5c1d5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.251744 Dec 21 04:12:12.603325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 538/1035] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:12 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:13.628402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-83b2f2ea-ecaf-44d7-a2e1-c58c94e6dd5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:13.628975 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-83b2f2ea-ecaf-44d7-a2e1-c58c94e6dd5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:13.637517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83b2f2ea-ecaf-44d7-a2e1-c58c94e6dd5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:13.638021 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83b2f2ea-ecaf-44d7-a2e1-c58c94e6dd5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:13.639939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83b2f2ea-ecaf-44d7-a2e1-c58c94e6dd5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:13.640434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83b2f2ea-ecaf-44d7-a2e1-c58c94e6dd5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:13.879518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-83b2f2ea-ecaf-44d7-a2e1-c58c94e6dd5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:13.889801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-83b2f2ea-ecaf-44d7-a2e1-c58c94e6dd5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.271175 Dec 21 04:12:13.890406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 498/1036] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:13 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:14.914465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c60327e9-944e-4f3e-93d9-61c1d2349647 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:14.915177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c60327e9-944e-4f3e-93d9-61c1d2349647 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:14.923301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c60327e9-944e-4f3e-93d9-61c1d2349647 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:14.923818 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c60327e9-944e-4f3e-93d9-61c1d2349647 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:14.924649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c60327e9-944e-4f3e-93d9-61c1d2349647 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:14.925150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c60327e9-944e-4f3e-93d9-61c1d2349647 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:15.141490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c60327e9-944e-4f3e-93d9-61c1d2349647 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:15.150423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c60327e9-944e-4f3e-93d9-61c1d2349647 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246110 Dec 21 04:12:15.151062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 539/1037] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:14 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:16.174686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a91549bd-5bee-49b4-9e90-27b40125ebec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:16.175337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a91549bd-5bee-49b4-9e90-27b40125ebec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:16.183271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a91549bd-5bee-49b4-9e90-27b40125ebec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:16.183779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a91549bd-5bee-49b4-9e90-27b40125ebec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:16.184607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a91549bd-5bee-49b4-9e90-27b40125ebec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:16.185127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a91549bd-5bee-49b4-9e90-27b40125ebec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:16.405194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a91549bd-5bee-49b4-9e90-27b40125ebec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:16.414236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a91549bd-5bee-49b4-9e90-27b40125ebec tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249441 Dec 21 04:12:16.418673 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 499/1038] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:16 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:17.438688 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cb7ffa78-b49b-4253-a7e3-d942801011db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:17.439386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cb7ffa78-b49b-4253-a7e3-d942801011db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:17.447655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cb7ffa78-b49b-4253-a7e3-d942801011db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:17.448216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cb7ffa78-b49b-4253-a7e3-d942801011db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:17.449061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cb7ffa78-b49b-4253-a7e3-d942801011db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:17.449553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cb7ffa78-b49b-4253-a7e3-d942801011db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:17.681366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cb7ffa78-b49b-4253-a7e3-d942801011db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:17.690851 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cb7ffa78-b49b-4253-a7e3-d942801011db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.261770 Dec 21 04:12:17.691473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 540/1039] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:17 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:18.714426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9ef213eb-5adc-4424-9664-3ed7e4fe8191 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:18.715083 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9ef213eb-5adc-4424-9664-3ed7e4fe8191 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:18.723810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9ef213eb-5adc-4424-9664-3ed7e4fe8191 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:18.724320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9ef213eb-5adc-4424-9664-3ed7e4fe8191 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:18.725145 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9ef213eb-5adc-4424-9664-3ed7e4fe8191 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:18.725638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9ef213eb-5adc-4424-9664-3ed7e4fe8191 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:18.944925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9ef213eb-5adc-4424-9664-3ed7e4fe8191 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:18.954430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9ef213eb-5adc-4424-9664-3ed7e4fe8191 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249192 Dec 21 04:12:18.955036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 500/1040] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:18 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:19.978640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ed7cc7d7-2e6e-4d6b-8249-838d1c744f77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:19.979338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ed7cc7d7-2e6e-4d6b-8249-838d1c744f77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:19.987470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed7cc7d7-2e6e-4d6b-8249-838d1c744f77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:19.987977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed7cc7d7-2e6e-4d6b-8249-838d1c744f77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:19.988809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed7cc7d7-2e6e-4d6b-8249-838d1c744f77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:19.989308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed7cc7d7-2e6e-4d6b-8249-838d1c744f77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:20.207693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ed7cc7d7-2e6e-4d6b-8249-838d1c744f77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:20.216782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ed7cc7d7-2e6e-4d6b-8249-838d1c744f77 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247237 Dec 21 04:12:20.217355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 541/1041] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:19 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:21.239803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f5b2071b-fcde-4819-a2e3-c4ab62e47135 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:21.240716 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f5b2071b-fcde-4819-a2e3-c4ab62e47135 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:21.249198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5b2071b-fcde-4819-a2e3-c4ab62e47135 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:21.249704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5b2071b-fcde-4819-a2e3-c4ab62e47135 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:21.250535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5b2071b-fcde-4819-a2e3-c4ab62e47135 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:21.251060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f5b2071b-fcde-4819-a2e3-c4ab62e47135 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:21.468484 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f5b2071b-fcde-4819-a2e3-c4ab62e47135 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:21.477298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f5b2071b-fcde-4819-a2e3-c4ab62e47135 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246796 Dec 21 04:12:21.478080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 501/1042] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:21 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:22.502483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9274abe6-ff19-47d9-9dd3-2fb280d71b91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:22.503204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9274abe6-ff19-47d9-9dd3-2fb280d71b91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:22.511278 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9274abe6-ff19-47d9-9dd3-2fb280d71b91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:22.511786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9274abe6-ff19-47d9-9dd3-2fb280d71b91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:22.512621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9274abe6-ff19-47d9-9dd3-2fb280d71b91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:22.513684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9274abe6-ff19-47d9-9dd3-2fb280d71b91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:22.733463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9274abe6-ff19-47d9-9dd3-2fb280d71b91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:22.742675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9274abe6-ff19-47d9-9dd3-2fb280d71b91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249739 Dec 21 04:12:22.743303 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 542/1043] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:22 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:23.766715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b13b83b6-3f77-418a-95d7-ab2202086998 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:23.767401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b13b83b6-3f77-418a-95d7-ab2202086998 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:23.775372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b13b83b6-3f77-418a-95d7-ab2202086998 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:23.775859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b13b83b6-3f77-418a-95d7-ab2202086998 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:23.776693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b13b83b6-3f77-418a-95d7-ab2202086998 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:23.777192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b13b83b6-3f77-418a-95d7-ab2202086998 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:23.996985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b13b83b6-3f77-418a-95d7-ab2202086998 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:24.006147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b13b83b6-3f77-418a-95d7-ab2202086998 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249160 Dec 21 04:12:24.006736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 502/1044] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:23 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:25.030565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4e231ccf-bd68-4f6e-b82b-11b1824f5fb7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:25.031253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4e231ccf-bd68-4f6e-b82b-11b1824f5fb7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:25.039204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e231ccf-bd68-4f6e-b82b-11b1824f5fb7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:25.039756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e231ccf-bd68-4f6e-b82b-11b1824f5fb7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:25.040584 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e231ccf-bd68-4f6e-b82b-11b1824f5fb7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:25.041075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e231ccf-bd68-4f6e-b82b-11b1824f5fb7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:25.259384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4e231ccf-bd68-4f6e-b82b-11b1824f5fb7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:25.268827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4e231ccf-bd68-4f6e-b82b-11b1824f5fb7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247997 Dec 21 04:12:25.269626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 543/1045] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:25 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:26.013244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:12:26.013393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:12:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:12:26.292631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-000f7ea8-cc9c-45b8-b5c3-c98bd2117efd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:26.293289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-000f7ea8-cc9c-45b8-b5c3-c98bd2117efd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:26.301872 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-000f7ea8-cc9c-45b8-b5c3-c98bd2117efd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:26.302376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-000f7ea8-cc9c-45b8-b5c3-c98bd2117efd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:26.303257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-000f7ea8-cc9c-45b8-b5c3-c98bd2117efd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:26.303745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-000f7ea8-cc9c-45b8-b5c3-c98bd2117efd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:26.409877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:12:26.410059 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:12:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:12:26.522711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-000f7ea8-cc9c-45b8-b5c3-c98bd2117efd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:26.532456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-000f7ea8-cc9c-45b8-b5c3-c98bd2117efd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248804 Dec 21 04:12:26.533066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 503/1046] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:26 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:27.556697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b14d0d3c-632c-4ae0-bba1-821badc93f73 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:27.557364 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b14d0d3c-632c-4ae0-bba1-821badc93f73 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:27.565850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b14d0d3c-632c-4ae0-bba1-821badc93f73 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:27.566360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b14d0d3c-632c-4ae0-bba1-821badc93f73 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:27.567210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b14d0d3c-632c-4ae0-bba1-821badc93f73 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:27.567709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b14d0d3c-632c-4ae0-bba1-821badc93f73 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:27.792678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b14d0d3c-632c-4ae0-bba1-821badc93f73 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:27.801971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b14d0d3c-632c-4ae0-bba1-821badc93f73 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.254362 Dec 21 04:12:27.802560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 544/1047] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:27 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:28.826980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5c934e4e-647f-43f3-bea4-ba6c87f1ba5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:28.827648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5c934e4e-647f-43f3-bea4-ba6c87f1ba5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:28.835466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5c934e4e-647f-43f3-bea4-ba6c87f1ba5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:28.835969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5c934e4e-647f-43f3-bea4-ba6c87f1ba5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:28.836799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5c934e4e-647f-43f3-bea4-ba6c87f1ba5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:28.837291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5c934e4e-647f-43f3-bea4-ba6c87f1ba5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:29.053260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5c934e4e-647f-43f3-bea4-ba6c87f1ba5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:29.062806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5c934e4e-647f-43f3-bea4-ba6c87f1ba5d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245492 Dec 21 04:12:29.063548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 504/1048] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:28 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:30.087036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-265fab87-e947-46f3-aacb-7e6ae49ab7d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:30.087708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-265fab87-e947-46f3-aacb-7e6ae49ab7d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:30.096091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-265fab87-e947-46f3-aacb-7e6ae49ab7d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:30.096599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-265fab87-e947-46f3-aacb-7e6ae49ab7d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:30.097433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-265fab87-e947-46f3-aacb-7e6ae49ab7d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:30.097931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-265fab87-e947-46f3-aacb-7e6ae49ab7d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:30.314242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-265fab87-e947-46f3-aacb-7e6ae49ab7d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:30.323529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-265fab87-e947-46f3-aacb-7e6ae49ab7d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245841 Dec 21 04:12:30.324134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 545/1049] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:30 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:31.348653 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-32f20b14-5a2d-437d-bbea-da0d00216dac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:31.349312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-32f20b14-5a2d-437d-bbea-da0d00216dac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:31.357266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-32f20b14-5a2d-437d-bbea-da0d00216dac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:31.357770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-32f20b14-5a2d-437d-bbea-da0d00216dac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:31.358606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-32f20b14-5a2d-437d-bbea-da0d00216dac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:31.359123 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-32f20b14-5a2d-437d-bbea-da0d00216dac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:31.578001 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-32f20b14-5a2d-437d-bbea-da0d00216dac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:31.586941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-32f20b14-5a2d-437d-bbea-da0d00216dac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248555 Dec 21 04:12:31.587540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 505/1050] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:31 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:32.610850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f510d958-3ae3-4024-8230-e2725165bbef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:32.611557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f510d958-3ae3-4024-8230-e2725165bbef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:32.619664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f510d958-3ae3-4024-8230-e2725165bbef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:32.620170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f510d958-3ae3-4024-8230-e2725165bbef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:32.620991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f510d958-3ae3-4024-8230-e2725165bbef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:32.621478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f510d958-3ae3-4024-8230-e2725165bbef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:32.837853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f510d958-3ae3-4024-8230-e2725165bbef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:32.847732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f510d958-3ae3-4024-8230-e2725165bbef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246069 Dec 21 04:12:32.848457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 546/1051] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:32 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:33.870697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9e1d10ce-ef6c-4df0-a120-82bff39ce961 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:33.871418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9e1d10ce-ef6c-4df0-a120-82bff39ce961 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:33.879482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9e1d10ce-ef6c-4df0-a120-82bff39ce961 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:33.879987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9e1d10ce-ef6c-4df0-a120-82bff39ce961 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:33.880816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9e1d10ce-ef6c-4df0-a120-82bff39ce961 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:33.881302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9e1d10ce-ef6c-4df0-a120-82bff39ce961 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:34.106599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9e1d10ce-ef6c-4df0-a120-82bff39ce961 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:34.116470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9e1d10ce-ef6c-4df0-a120-82bff39ce961 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.254803 Dec 21 04:12:34.117070 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 506/1052] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:33 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:35.139557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-57921d22-d0da-47fb-a270-c1ff35ea4b3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:35.140227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-57921d22-d0da-47fb-a270-c1ff35ea4b3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:35.148228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-57921d22-d0da-47fb-a270-c1ff35ea4b3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:35.148733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-57921d22-d0da-47fb-a270-c1ff35ea4b3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:35.149565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-57921d22-d0da-47fb-a270-c1ff35ea4b3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:35.150058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-57921d22-d0da-47fb-a270-c1ff35ea4b3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:35.373090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-57921d22-d0da-47fb-a270-c1ff35ea4b3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:35.381999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-57921d22-d0da-47fb-a270-c1ff35ea4b3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.251712 Dec 21 04:12:35.382589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 547/1053] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:35 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:36.404946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-30b0bf16-4ddf-477d-8ae3-492c7e082153 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:36.405603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-30b0bf16-4ddf-477d-8ae3-492c7e082153 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:36.413538 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30b0bf16-4ddf-477d-8ae3-492c7e082153 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:36.414042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30b0bf16-4ddf-477d-8ae3-492c7e082153 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:36.414868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30b0bf16-4ddf-477d-8ae3-492c7e082153 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:36.415388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30b0bf16-4ddf-477d-8ae3-492c7e082153 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:36.634858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-30b0bf16-4ddf-477d-8ae3-492c7e082153 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:36.644050 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-30b0bf16-4ddf-477d-8ae3-492c7e082153 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248083 Dec 21 04:12:36.644653 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 507/1054] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:36 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:36.951358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:12:36.951537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:12:36 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:12:37.667577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7b73c9de-0f6b-4bea-802b-8bdade994007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:37.668245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7b73c9de-0f6b-4bea-802b-8bdade994007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:37.676165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b73c9de-0f6b-4bea-802b-8bdade994007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:37.676668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b73c9de-0f6b-4bea-802b-8bdade994007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:37.677494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b73c9de-0f6b-4bea-802b-8bdade994007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:37.677985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b73c9de-0f6b-4bea-802b-8bdade994007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:37.895509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7b73c9de-0f6b-4bea-802b-8bdade994007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:37.905116 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7b73c9de-0f6b-4bea-802b-8bdade994007 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246539 Dec 21 04:12:37.905904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 548/1055] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:37 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:38.927836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5a95bb4b-f149-4734-85e6-c360b8865d45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:38.928505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5a95bb4b-f149-4734-85e6-c360b8865d45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:38.936554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a95bb4b-f149-4734-85e6-c360b8865d45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:38.937068 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a95bb4b-f149-4734-85e6-c360b8865d45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:38.937906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a95bb4b-f149-4734-85e6-c360b8865d45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:38.938414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a95bb4b-f149-4734-85e6-c360b8865d45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:39.156663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5a95bb4b-f149-4734-85e6-c360b8865d45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:39.165598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5a95bb4b-f149-4734-85e6-c360b8865d45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246900 Dec 21 04:12:39.166189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 508/1056] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:38 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:40.188909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fd4947d7-0960-45ec-87ca-10e0175fbc7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:40.189570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fd4947d7-0960-45ec-87ca-10e0175fbc7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:40.197386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fd4947d7-0960-45ec-87ca-10e0175fbc7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:40.197888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fd4947d7-0960-45ec-87ca-10e0175fbc7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:40.198707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fd4947d7-0960-45ec-87ca-10e0175fbc7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:40.199243 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fd4947d7-0960-45ec-87ca-10e0175fbc7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:40.414088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fd4947d7-0960-45ec-87ca-10e0175fbc7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:40.423067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fd4947d7-0960-45ec-87ca-10e0175fbc7c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.243365 Dec 21 04:12:40.423657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 549/1057] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:40 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:41.446464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4c979289-3d87-418b-a9df-3855981440f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:41.447163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4c979289-3d87-418b-a9df-3855981440f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:41.455230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c979289-3d87-418b-a9df-3855981440f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:41.455668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c979289-3d87-418b-a9df-3855981440f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:41.456707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c979289-3d87-418b-a9df-3855981440f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:41.457209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c979289-3d87-418b-a9df-3855981440f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:41.678999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4c979289-3d87-418b-a9df-3855981440f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:41.687976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4c979289-3d87-418b-a9df-3855981440f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.250563 Dec 21 04:12:41.688566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 509/1058] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:41 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:42.711343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3a28e79e-527e-4d85-b11c-0692df1af373 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:42.712018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3a28e79e-527e-4d85-b11c-0692df1af373 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:42.720057 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a28e79e-527e-4d85-b11c-0692df1af373 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:42.720569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a28e79e-527e-4d85-b11c-0692df1af373 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:42.721403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a28e79e-527e-4d85-b11c-0692df1af373 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:42.721896 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a28e79e-527e-4d85-b11c-0692df1af373 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:42.946925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3a28e79e-527e-4d85-b11c-0692df1af373 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:42.955803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3a28e79e-527e-4d85-b11c-0692df1af373 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.253686 Dec 21 04:12:42.956382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 550/1059] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:42 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:43.979867 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-edaae9e4-ecd3-43a9-bd65-0d58c2b68579 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:43.980532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-edaae9e4-ecd3-43a9-bd65-0d58c2b68579 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:43.988985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-edaae9e4-ecd3-43a9-bd65-0d58c2b68579 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:43.989490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-edaae9e4-ecd3-43a9-bd65-0d58c2b68579 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:43.990319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-edaae9e4-ecd3-43a9-bd65-0d58c2b68579 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:43.991107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-edaae9e4-ecd3-43a9-bd65-0d58c2b68579 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:44.208214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-edaae9e4-ecd3-43a9-bd65-0d58c2b68579 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:44.217440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-edaae9e4-ecd3-43a9-bd65-0d58c2b68579 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246718 Dec 21 04:12:44.218044 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 510/1060] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:43 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:45.240489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3a156897-f139-4148-bb34-b7cdbb781504 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:45.241408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3a156897-f139-4148-bb34-b7cdbb781504 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:45.249957 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a156897-f139-4148-bb34-b7cdbb781504 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:45.250464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a156897-f139-4148-bb34-b7cdbb781504 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:45.251314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a156897-f139-4148-bb34-b7cdbb781504 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:45.252249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a156897-f139-4148-bb34-b7cdbb781504 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:45.467664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3a156897-f139-4148-bb34-b7cdbb781504 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:45.476692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3a156897-f139-4148-bb34-b7cdbb781504 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245587 Dec 21 04:12:45.477307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 551/1061] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:45 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:46.500672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b3bf3476-1d5d-43a4-a41a-9a2746f4fd84 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:46.501341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b3bf3476-1d5d-43a4-a41a-9a2746f4fd84 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:46.509259 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3bf3476-1d5d-43a4-a41a-9a2746f4fd84 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:46.509767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3bf3476-1d5d-43a4-a41a-9a2746f4fd84 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:46.510599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3bf3476-1d5d-43a4-a41a-9a2746f4fd84 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:46.511129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3bf3476-1d5d-43a4-a41a-9a2746f4fd84 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:46.729813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b3bf3476-1d5d-43a4-a41a-9a2746f4fd84 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:46.738833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b3bf3476-1d5d-43a4-a41a-9a2746f4fd84 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247082 Dec 21 04:12:46.739444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 511/1062] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:46 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:47.763360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9713e32c-299a-426d-9b99-7785a5bde2b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:47.764531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9713e32c-299a-426d-9b99-7785a5bde2b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:47.772503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9713e32c-299a-426d-9b99-7785a5bde2b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:47.773009 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9713e32c-299a-426d-9b99-7785a5bde2b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:47.773839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9713e32c-299a-426d-9b99-7785a5bde2b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:47.774448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9713e32c-299a-426d-9b99-7785a5bde2b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:48.194368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9713e32c-299a-426d-9b99-7785a5bde2b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:48.204071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9713e32c-299a-426d-9b99-7785a5bde2b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.450551 Dec 21 04:12:48.204658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 552/1063] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:47 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:49.227497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4c4017fd-fcaa-46dc-907c-a45279b3f21c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:49.228161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4c4017fd-fcaa-46dc-907c-a45279b3f21c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:49.236742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c4017fd-fcaa-46dc-907c-a45279b3f21c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:49.237249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c4017fd-fcaa-46dc-907c-a45279b3f21c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:49.238073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c4017fd-fcaa-46dc-907c-a45279b3f21c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:49.238560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c4017fd-fcaa-46dc-907c-a45279b3f21c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:49.523606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4c4017fd-fcaa-46dc-907c-a45279b3f21c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:49.532689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4c4017fd-fcaa-46dc-907c-a45279b3f21c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.314422 Dec 21 04:12:49.533268 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 512/1064] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:49 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:50.556915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e580e390-a2d4-4b86-9ede-569b60e21a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:50.557514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e580e390-a2d4-4b86-9ede-569b60e21a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:50.566062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e580e390-a2d4-4b86-9ede-569b60e21a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:50.566573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e580e390-a2d4-4b86-9ede-569b60e21a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:50.567447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e580e390-a2d4-4b86-9ede-569b60e21a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:50.567943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e580e390-a2d4-4b86-9ede-569b60e21a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:50.789482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e580e390-a2d4-4b86-9ede-569b60e21a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:50.798953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e580e390-a2d4-4b86-9ede-569b60e21a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.252002 Dec 21 04:12:50.799545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 553/1065] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:50 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:51.822097 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6b838ad1-11e1-4fe2-aa4d-8aa489b3b865 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:51.822759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6b838ad1-11e1-4fe2-aa4d-8aa489b3b865 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:51.831249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6b838ad1-11e1-4fe2-aa4d-8aa489b3b865 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:51.831760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6b838ad1-11e1-4fe2-aa4d-8aa489b3b865 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:51.832592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6b838ad1-11e1-4fe2-aa4d-8aa489b3b865 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:51.833089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6b838ad1-11e1-4fe2-aa4d-8aa489b3b865 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:52.057549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6b838ad1-11e1-4fe2-aa4d-8aa489b3b865 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:52.066499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6b838ad1-11e1-4fe2-aa4d-8aa489b3b865 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.253438 Dec 21 04:12:52.067122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 513/1066] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:51 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:53.089798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a8a1ac89-2252-4169-81c4-6f748b9fb1f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:53.090439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a8a1ac89-2252-4169-81c4-6f748b9fb1f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:53.098884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8a1ac89-2252-4169-81c4-6f748b9fb1f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:53.099427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8a1ac89-2252-4169-81c4-6f748b9fb1f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:53.100267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8a1ac89-2252-4169-81c4-6f748b9fb1f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:53.100815 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a8a1ac89-2252-4169-81c4-6f748b9fb1f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:53.318559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a8a1ac89-2252-4169-81c4-6f748b9fb1f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:53.327817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a8a1ac89-2252-4169-81c4-6f748b9fb1f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247134 Dec 21 04:12:53.328419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 554/1067] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:53 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:54.351166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3b81b524-aa3c-4a02-9ae1-82395da172db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:54.351832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3b81b524-aa3c-4a02-9ae1-82395da172db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:54.359726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3b81b524-aa3c-4a02-9ae1-82395da172db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:54.360261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3b81b524-aa3c-4a02-9ae1-82395da172db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:54.361066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3b81b524-aa3c-4a02-9ae1-82395da172db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:54.361559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3b81b524-aa3c-4a02-9ae1-82395da172db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:54.579477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3b81b524-aa3c-4a02-9ae1-82395da172db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:54.588301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3b81b524-aa3c-4a02-9ae1-82395da172db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246345 Dec 21 04:12:54.588891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 514/1068] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:54 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:55.612503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5a4831cc-9716-4b8d-b3d5-00ae00a14bb1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:55.613170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5a4831cc-9716-4b8d-b3d5-00ae00a14bb1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:55.621217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a4831cc-9716-4b8d-b3d5-00ae00a14bb1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:55.622219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a4831cc-9716-4b8d-b3d5-00ae00a14bb1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:55.623059 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a4831cc-9716-4b8d-b3d5-00ae00a14bb1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:55.623544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a4831cc-9716-4b8d-b3d5-00ae00a14bb1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:55.839361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5a4831cc-9716-4b8d-b3d5-00ae00a14bb1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:55.848466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5a4831cc-9716-4b8d-b3d5-00ae00a14bb1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245325 Dec 21 04:12:55.849245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 555/1069] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:55 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:56.871384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4613a612-b778-477a-b817-d84ff08ad1b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:56.872103 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4613a612-b778-477a-b817-d84ff08ad1b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:56.879978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4613a612-b778-477a-b817-d84ff08ad1b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:56.880477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4613a612-b778-477a-b817-d84ff08ad1b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:56.881298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4613a612-b778-477a-b817-d84ff08ad1b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:56.881788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4613a612-b778-477a-b817-d84ff08ad1b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:57.096645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4613a612-b778-477a-b817-d84ff08ad1b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:57.105502 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4613a612-b778-477a-b817-d84ff08ad1b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.243599 Dec 21 04:12:57.106153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 515/1070] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:56 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:58.129235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a372277e-e442-48eb-9c28-e8178f094b59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:58.129891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a372277e-e442-48eb-9c28-e8178f094b59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:58.137768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a372277e-e442-48eb-9c28-e8178f094b59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:58.138269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a372277e-e442-48eb-9c28-e8178f094b59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:58.139126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a372277e-e442-48eb-9c28-e8178f094b59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:58.139616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a372277e-e442-48eb-9c28-e8178f094b59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:58.366331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a372277e-e442-48eb-9c28-e8178f094b59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:58.375229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a372277e-e442-48eb-9c28-e8178f094b59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.255188 Dec 21 04:12:58.375862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 556/1071] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:58 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:12:59.398287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6775f9ae-ff37-497c-b17f-a840346617a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:12:59.398977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6775f9ae-ff37-497c-b17f-a840346617a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:12:59.407445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6775f9ae-ff37-497c-b17f-a840346617a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:59.407956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6775f9ae-ff37-497c-b17f-a840346617a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:59.408787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6775f9ae-ff37-497c-b17f-a840346617a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:12:59.409278 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6775f9ae-ff37-497c-b17f-a840346617a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:12:59.636845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6775f9ae-ff37-497c-b17f-a840346617a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:12:59.645917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6775f9ae-ff37-497c-b17f-a840346617a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.256586 Dec 21 04:12:59.646451 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 516/1072] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:12:59 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:00.670490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-083e16cb-ebde-437d-838d-ef56266fabac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:00.671185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-083e16cb-ebde-437d-838d-ef56266fabac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:00.679160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-083e16cb-ebde-437d-838d-ef56266fabac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:00.679665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-083e16cb-ebde-437d-838d-ef56266fabac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:00.680490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-083e16cb-ebde-437d-838d-ef56266fabac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:00.680980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-083e16cb-ebde-437d-838d-ef56266fabac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:00.898530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-083e16cb-ebde-437d-838d-ef56266fabac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:00.908198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-083e16cb-ebde-437d-838d-ef56266fabac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247248 Dec 21 04:13:00.908794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 557/1073] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:00 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:01.931926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-59cf7875-2228-4bef-9e14-9e87e4a12f0e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:01.932592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-59cf7875-2228-4bef-9e14-9e87e4a12f0e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:01.941181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-59cf7875-2228-4bef-9e14-9e87e4a12f0e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:01.941762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-59cf7875-2228-4bef-9e14-9e87e4a12f0e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:01.942568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-59cf7875-2228-4bef-9e14-9e87e4a12f0e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:01.943080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-59cf7875-2228-4bef-9e14-9e87e4a12f0e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:02.170844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-59cf7875-2228-4bef-9e14-9e87e4a12f0e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:02.179692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-59cf7875-2228-4bef-9e14-9e87e4a12f0e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.256831 Dec 21 04:13:02.180438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 517/1074] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:01 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:03.204322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1637b691-3dee-4ce5-b17b-40325b0bcbdb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:03.204986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1637b691-3dee-4ce5-b17b-40325b0bcbdb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:03.212887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1637b691-3dee-4ce5-b17b-40325b0bcbdb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:03.213390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1637b691-3dee-4ce5-b17b-40325b0bcbdb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:03.214207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1637b691-3dee-4ce5-b17b-40325b0bcbdb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:03.214695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1637b691-3dee-4ce5-b17b-40325b0bcbdb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:03.431907 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1637b691-3dee-4ce5-b17b-40325b0bcbdb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:03.442024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1637b691-3dee-4ce5-b17b-40325b0bcbdb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247554 Dec 21 04:13:03.442606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 558/1075] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:03 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:04.467245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d81ed36b-952d-46e5-87a2-413fa3f404f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:04.467917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d81ed36b-952d-46e5-87a2-413fa3f404f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:04.476587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d81ed36b-952d-46e5-87a2-413fa3f404f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:04.477106 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d81ed36b-952d-46e5-87a2-413fa3f404f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:04.477948 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d81ed36b-952d-46e5-87a2-413fa3f404f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:04.478443 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d81ed36b-952d-46e5-87a2-413fa3f404f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:04.695190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d81ed36b-952d-46e5-87a2-413fa3f404f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:04.704640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d81ed36b-952d-46e5-87a2-413fa3f404f4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247795 Dec 21 04:13:04.705233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 518/1076] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:04 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:05.727952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-60270d25-90c6-466a-a19f-b525c373e5b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:05.728805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-60270d25-90c6-466a-a19f-b525c373e5b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:05.737455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-60270d25-90c6-466a-a19f-b525c373e5b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:05.737991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-60270d25-90c6-466a-a19f-b525c373e5b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:05.738933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-60270d25-90c6-466a-a19f-b525c373e5b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:05.739460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-60270d25-90c6-466a-a19f-b525c373e5b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:05.958917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-60270d25-90c6-466a-a19f-b525c373e5b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:05.968225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-60270d25-90c6-466a-a19f-b525c373e5b8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249482 Dec 21 04:13:05.968822 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 559/1077] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:05 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:06.991760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d43d12f0-1403-464a-a7c5-5ce762b1d73b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:06.992442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d43d12f0-1403-464a-a7c5-5ce762b1d73b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:07.001107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d43d12f0-1403-464a-a7c5-5ce762b1d73b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:07.001623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d43d12f0-1403-464a-a7c5-5ce762b1d73b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:07.002454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d43d12f0-1403-464a-a7c5-5ce762b1d73b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:07.002973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d43d12f0-1403-464a-a7c5-5ce762b1d73b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:07.227940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d43d12f0-1403-464a-a7c5-5ce762b1d73b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:07.237248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d43d12f0-1403-464a-a7c5-5ce762b1d73b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.254732 Dec 21 04:13:07.237834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 519/1078] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:06 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:08.263287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e750bfe5-4535-4105-96bd-3e0c63c78ab1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:08.264056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e750bfe5-4535-4105-96bd-3e0c63c78ab1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:08.272156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e750bfe5-4535-4105-96bd-3e0c63c78ab1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:08.272742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e750bfe5-4535-4105-96bd-3e0c63c78ab1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:08.273727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e750bfe5-4535-4105-96bd-3e0c63c78ab1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:08.274306 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e750bfe5-4535-4105-96bd-3e0c63c78ab1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:08.493834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e750bfe5-4535-4105-96bd-3e0c63c78ab1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:08.503647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e750bfe5-4535-4105-96bd-3e0c63c78ab1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.250273 Dec 21 04:13:08.504240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 560/1079] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:08 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:09.529366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d172519f-078c-4d60-b23e-baec03c0c72d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:09.530032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d172519f-078c-4d60-b23e-baec03c0c72d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:09.537939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d172519f-078c-4d60-b23e-baec03c0c72d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:09.538456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d172519f-078c-4d60-b23e-baec03c0c72d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:09.539320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d172519f-078c-4d60-b23e-baec03c0c72d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:09.539816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d172519f-078c-4d60-b23e-baec03c0c72d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:09.758742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d172519f-078c-4d60-b23e-baec03c0c72d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:09.768323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d172519f-078c-4d60-b23e-baec03c0c72d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249264 Dec 21 04:13:09.768971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 520/1080] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:09 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:10.792463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-125d8ee7-41d9-45eb-afe2-27b08539099f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:10.793206 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-125d8ee7-41d9-45eb-afe2-27b08539099f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:10.801390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-125d8ee7-41d9-45eb-afe2-27b08539099f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:10.801901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-125d8ee7-41d9-45eb-afe2-27b08539099f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:10.802737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-125d8ee7-41d9-45eb-afe2-27b08539099f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:10.803257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-125d8ee7-41d9-45eb-afe2-27b08539099f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:11.024322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-125d8ee7-41d9-45eb-afe2-27b08539099f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:11.033454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-125d8ee7-41d9-45eb-afe2-27b08539099f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.250387 Dec 21 04:13:11.034055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 561/1081] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:10 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:12.057385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fbfe83f3-8dff-4d28-bef1-f758a2cee7bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:12.058051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fbfe83f3-8dff-4d28-bef1-f758a2cee7bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:12.066446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbfe83f3-8dff-4d28-bef1-f758a2cee7bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:12.066980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbfe83f3-8dff-4d28-bef1-f758a2cee7bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:12.067811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbfe83f3-8dff-4d28-bef1-f758a2cee7bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:12.068304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fbfe83f3-8dff-4d28-bef1-f758a2cee7bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:12.286284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fbfe83f3-8dff-4d28-bef1-f758a2cee7bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:12.295663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fbfe83f3-8dff-4d28-bef1-f758a2cee7bd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247188 Dec 21 04:13:12.296269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 521/1082] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:12 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:13.321705 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c401c081-c407-4304-aa9b-56e227b02851 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:13.323041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c401c081-c407-4304-aa9b-56e227b02851 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:13.331567 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c401c081-c407-4304-aa9b-56e227b02851 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:13.332069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c401c081-c407-4304-aa9b-56e227b02851 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:13.332900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c401c081-c407-4304-aa9b-56e227b02851 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:13.333390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c401c081-c407-4304-aa9b-56e227b02851 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:13.576585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c401c081-c407-4304-aa9b-56e227b02851 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:13.585701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c401c081-c407-4304-aa9b-56e227b02851 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.275337 Dec 21 04:13:13.586300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 562/1083] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:13 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:14.610020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-31b6fdad-0784-4f5b-8c2b-c3af1f8a6aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:14.610678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-31b6fdad-0784-4f5b-8c2b-c3af1f8a6aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:14.618715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31b6fdad-0784-4f5b-8c2b-c3af1f8a6aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:14.619250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31b6fdad-0784-4f5b-8c2b-c3af1f8a6aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:14.620071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31b6fdad-0784-4f5b-8c2b-c3af1f8a6aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:14.620557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31b6fdad-0784-4f5b-8c2b-c3af1f8a6aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:14.843547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-31b6fdad-0784-4f5b-8c2b-c3af1f8a6aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:14.852556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-31b6fdad-0784-4f5b-8c2b-c3af1f8a6aaa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.252521 Dec 21 04:13:14.853351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 522/1084] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:14 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:15.876620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d9d0faac-19b2-4e23-af6d-b1a12e502564 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:15.877285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d9d0faac-19b2-4e23-af6d-b1a12e502564 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:15.885206 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d9d0faac-19b2-4e23-af6d-b1a12e502564 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:15.885714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d9d0faac-19b2-4e23-af6d-b1a12e502564 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:15.886610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d9d0faac-19b2-4e23-af6d-b1a12e502564 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:15.887353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d9d0faac-19b2-4e23-af6d-b1a12e502564 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:16.110088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d9d0faac-19b2-4e23-af6d-b1a12e502564 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:16.119254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d9d0faac-19b2-4e23-af6d-b1a12e502564 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.252171 Dec 21 04:13:16.119843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 563/1085] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:15 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:17.142867 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6110b638-9318-444a-813c-9ccb69893a23 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:17.143558 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6110b638-9318-444a-813c-9ccb69893a23 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:17.151474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6110b638-9318-444a-813c-9ccb69893a23 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:17.151981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6110b638-9318-444a-813c-9ccb69893a23 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:17.152818 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6110b638-9318-444a-813c-9ccb69893a23 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:17.153308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6110b638-9318-444a-813c-9ccb69893a23 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:17.371895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6110b638-9318-444a-813c-9ccb69893a23 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:17.380969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6110b638-9318-444a-813c-9ccb69893a23 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247538 Dec 21 04:13:17.381569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 523/1086] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:17 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:13:18.404873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2cfc8364-030e-4ac5-8f56-3c80b20c9307 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:18.405503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2cfc8364-030e-4ac5-8f56-3c80b20c9307 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:18.413375 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2cfc8364-030e-4ac5-8f56-3c80b20c9307 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:18.413878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2cfc8364-030e-4ac5-8f56-3c80b20c9307 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:18.414700 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2cfc8364-030e-4ac5-8f56-3c80b20c9307 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:18.415210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2cfc8364-030e-4ac5-8f56-3c80b20c9307 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:18.634609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2cfc8364-030e-4ac5-8f56-3c80b20c9307 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:18.643670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2cfc8364-030e-4ac5-8f56-3c80b20c9307 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248422 Dec 21 04:13:18.644257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 564/1087] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:18 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:19.666861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5066de73-18ca-419f-8142-7df58e97d995 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:19.667708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5066de73-18ca-419f-8142-7df58e97d995 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:19.675855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5066de73-18ca-419f-8142-7df58e97d995 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:19.676367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5066de73-18ca-419f-8142-7df58e97d995 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:19.677191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5066de73-18ca-419f-8142-7df58e97d995 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:19.677677 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5066de73-18ca-419f-8142-7df58e97d995 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:19.897513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5066de73-18ca-419f-8142-7df58e97d995 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:19.907055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5066de73-18ca-419f-8142-7df58e97d995 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249211 Dec 21 04:13:19.907849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 524/1088] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:19 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:20.930280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-058bb2f5-d065-4086-827f-c6630d934815 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:20.930877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-058bb2f5-d065-4086-827f-c6630d934815 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:20.939164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-058bb2f5-d065-4086-827f-c6630d934815 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:20.939667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-058bb2f5-d065-4086-827f-c6630d934815 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:20.940482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-058bb2f5-d065-4086-827f-c6630d934815 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:20.940970 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-058bb2f5-d065-4086-827f-c6630d934815 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:21.169745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-058bb2f5-d065-4086-827f-c6630d934815 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:21.178656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-058bb2f5-d065-4086-827f-c6630d934815 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.257629 Dec 21 04:13:21.179311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 565/1089] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:20 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:22.203709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9a3146e6-ee32-48a4-b6d1-9563dc25ab61 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:22.204503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9a3146e6-ee32-48a4-b6d1-9563dc25ab61 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:22.212475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9a3146e6-ee32-48a4-b6d1-9563dc25ab61 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:22.213088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9a3146e6-ee32-48a4-b6d1-9563dc25ab61 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:22.214005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9a3146e6-ee32-48a4-b6d1-9563dc25ab61 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:22.215267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9a3146e6-ee32-48a4-b6d1-9563dc25ab61 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:22.437735 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9a3146e6-ee32-48a4-b6d1-9563dc25ab61 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:22.446760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9a3146e6-ee32-48a4-b6d1-9563dc25ab61 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.253350 Dec 21 04:13:22.447635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 525/1090] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:22 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:23.471820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b6aa782c-324d-447e-9235-486321aa71a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:23.472530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b6aa782c-324d-447e-9235-486321aa71a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:23.480524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b6aa782c-324d-447e-9235-486321aa71a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:23.481040 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b6aa782c-324d-447e-9235-486321aa71a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:23.481884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b6aa782c-324d-447e-9235-486321aa71a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:23.482378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b6aa782c-324d-447e-9235-486321aa71a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:23.701882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b6aa782c-324d-447e-9235-486321aa71a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:23.711089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b6aa782c-324d-447e-9235-486321aa71a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.249092 Dec 21 04:13:23.711692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 566/1091] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:23 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:24.734674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-983cf5c8-c840-47bc-a32b-5163e01b500e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:24.735305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-983cf5c8-c840-47bc-a32b-5163e01b500e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:24.743470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-983cf5c8-c840-47bc-a32b-5163e01b500e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:24.743979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-983cf5c8-c840-47bc-a32b-5163e01b500e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:24.744814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-983cf5c8-c840-47bc-a32b-5163e01b500e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:24.745311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-983cf5c8-c840-47bc-a32b-5163e01b500e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:24.962403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-983cf5c8-c840-47bc-a32b-5163e01b500e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:24.971367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-983cf5c8-c840-47bc-a32b-5163e01b500e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245806 Dec 21 04:13:24.971957 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 526/1092] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:24 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:25.995010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1d60a99f-fc50-4b86-8e82-cda31fb099a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:25.995833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1d60a99f-fc50-4b86-8e82-cda31fb099a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:26.004027 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1d60a99f-fc50-4b86-8e82-cda31fb099a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:26.004541 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1d60a99f-fc50-4b86-8e82-cda31fb099a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:26.005372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1d60a99f-fc50-4b86-8e82-cda31fb099a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:26.005873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1d60a99f-fc50-4b86-8e82-cda31fb099a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:26.222822 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1d60a99f-fc50-4b86-8e82-cda31fb099a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:26.232840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1d60a99f-fc50-4b86-8e82-cda31fb099a7 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247160 Dec 21 04:13:26.233642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 567/1093] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:25 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:13:27.257138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8d8ed45d-2632-4f85-bac2-ce6e132569a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:27.257814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8d8ed45d-2632-4f85-bac2-ce6e132569a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:27.266174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d8ed45d-2632-4f85-bac2-ce6e132569a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:27.266688 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d8ed45d-2632-4f85-bac2-ce6e132569a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:27.267574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d8ed45d-2632-4f85-bac2-ce6e132569a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:27.268073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d8ed45d-2632-4f85-bac2-ce6e132569a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:27.505465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8d8ed45d-2632-4f85-bac2-ce6e132569a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:27.515063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8d8ed45d-2632-4f85-bac2-ce6e132569a4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.267369 Dec 21 04:13:27.515593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 527/1094] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:27 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:28.538336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3c2063b1-c44e-414b-bf4c-0cf76b9ae496 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:28.539064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3c2063b1-c44e-414b-bf4c-0cf76b9ae496 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:28.547398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c2063b1-c44e-414b-bf4c-0cf76b9ae496 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:28.547907 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c2063b1-c44e-414b-bf4c-0cf76b9ae496 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:28.548732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c2063b1-c44e-414b-bf4c-0cf76b9ae496 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:28.549217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3c2063b1-c44e-414b-bf4c-0cf76b9ae496 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:28.772327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3c2063b1-c44e-414b-bf4c-0cf76b9ae496 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:28.782037 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3c2063b1-c44e-414b-bf4c-0cf76b9ae496 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.252907 Dec 21 04:13:28.782810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 568/1095] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:28 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:29.805442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cbeb973e-434d-4207-9f10-cccb984fc206 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:29.806115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cbeb973e-434d-4207-9f10-cccb984fc206 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:29.814811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbeb973e-434d-4207-9f10-cccb984fc206 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:29.815363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbeb973e-434d-4207-9f10-cccb984fc206 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:29.816198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbeb973e-434d-4207-9f10-cccb984fc206 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:29.816697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cbeb973e-434d-4207-9f10-cccb984fc206 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:30.040180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cbeb973e-434d-4207-9f10-cccb984fc206 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:30.049543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cbeb973e-434d-4207-9f10-cccb984fc206 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.253242 Dec 21 04:13:30.050132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 528/1096] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:29 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:31.074310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9d7d457f-7564-4ebe-a512-ac4bed117912 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:31.075072 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9d7d457f-7564-4ebe-a512-ac4bed117912 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:31.082877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9d7d457f-7564-4ebe-a512-ac4bed117912 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:31.083430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9d7d457f-7564-4ebe-a512-ac4bed117912 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:31.084298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9d7d457f-7564-4ebe-a512-ac4bed117912 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:31.084789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9d7d457f-7564-4ebe-a512-ac4bed117912 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:31.300406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9d7d457f-7564-4ebe-a512-ac4bed117912 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:31.309985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9d7d457f-7564-4ebe-a512-ac4bed117912 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245716 Dec 21 04:13:31.310573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 569/1097] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:31 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:32.333065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9b09dabe-1c87-47d7-a54b-4107b7084180 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:32.333633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9b09dabe-1c87-47d7-a54b-4107b7084180 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:32.341666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9b09dabe-1c87-47d7-a54b-4107b7084180 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:32.342169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9b09dabe-1c87-47d7-a54b-4107b7084180 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:32.343019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9b09dabe-1c87-47d7-a54b-4107b7084180 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:32.343511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9b09dabe-1c87-47d7-a54b-4107b7084180 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:32.561622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9b09dabe-1c87-47d7-a54b-4107b7084180 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:32.570608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9b09dabe-1c87-47d7-a54b-4107b7084180 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247323 Dec 21 04:13:32.571213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 529/1098] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:32 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:33.594548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-388fe53a-60d9-4f73-803a-53ee615ee3f0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:33.595238 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-388fe53a-60d9-4f73-803a-53ee615ee3f0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:33.603254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-388fe53a-60d9-4f73-803a-53ee615ee3f0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:33.603758 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-388fe53a-60d9-4f73-803a-53ee615ee3f0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:33.604588 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-388fe53a-60d9-4f73-803a-53ee615ee3f0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:33.605659 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-388fe53a-60d9-4f73-803a-53ee615ee3f0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:33.821398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-388fe53a-60d9-4f73-803a-53ee615ee3f0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:33.830475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-388fe53a-60d9-4f73-803a-53ee615ee3f0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245376 Dec 21 04:13:33.831096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 570/1099] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:33 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:34.854261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1a9c7c84-ab4f-47ec-88d9-12065fbb7731 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:34.855097 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1a9c7c84-ab4f-47ec-88d9-12065fbb7731 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:34.863078 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a9c7c84-ab4f-47ec-88d9-12065fbb7731 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:34.863584 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a9c7c84-ab4f-47ec-88d9-12065fbb7731 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:34.864404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a9c7c84-ab4f-47ec-88d9-12065fbb7731 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:34.864896 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a9c7c84-ab4f-47ec-88d9-12065fbb7731 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:35.083829 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1a9c7c84-ab4f-47ec-88d9-12065fbb7731 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:35.093450 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1a9c7c84-ab4f-47ec-88d9-12065fbb7731 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248129 Dec 21 04:13:35.094049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 530/1100] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:34 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:36.117286 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b42f2cf4-888e-42d2-85c2-3b3f1d51cc5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:36.117958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b42f2cf4-888e-42d2-85c2-3b3f1d51cc5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:36.125998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b42f2cf4-888e-42d2-85c2-3b3f1d51cc5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:36.126806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b42f2cf4-888e-42d2-85c2-3b3f1d51cc5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:36.127695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b42f2cf4-888e-42d2-85c2-3b3f1d51cc5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:36.128187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b42f2cf4-888e-42d2-85c2-3b3f1d51cc5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:36.354074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b42f2cf4-888e-42d2-85c2-3b3f1d51cc5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:36.363506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b42f2cf4-888e-42d2-85c2-3b3f1d51cc5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.255423 Dec 21 04:13:36.364100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 571/1101] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:36 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:37.387515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-623e6467-03bd-4100-998c-b46da933bc63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:37.388179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-623e6467-03bd-4100-998c-b46da933bc63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:37.396037 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-623e6467-03bd-4100-998c-b46da933bc63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:37.396547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-623e6467-03bd-4100-998c-b46da933bc63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:37.397382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-623e6467-03bd-4100-998c-b46da933bc63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:37.397875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-623e6467-03bd-4100-998c-b46da933bc63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:37.623489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-623e6467-03bd-4100-998c-b46da933bc63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:37.632455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-623e6467-03bd-4100-998c-b46da933bc63 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.254095 Dec 21 04:13:37.633036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 531/1102] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:37 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:38.654874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3b0a3836-373e-43de-864e-9096f7d37170 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:38.655677 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3b0a3836-373e-43de-864e-9096f7d37170 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:38.664759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3b0a3836-373e-43de-864e-9096f7d37170 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:38.664759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3b0a3836-373e-43de-864e-9096f7d37170 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:38.665147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3b0a3836-373e-43de-864e-9096f7d37170 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:38.665621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3b0a3836-373e-43de-864e-9096f7d37170 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:38.890777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3b0a3836-373e-43de-864e-9096f7d37170 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:38.899957 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3b0a3836-373e-43de-864e-9096f7d37170 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.254241 Dec 21 04:13:38.900559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 572/1103] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:38 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:39.922815 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3fab1980-b60b-4d11-b04c-53101e8d35b4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:39.923515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3fab1980-b60b-4d11-b04c-53101e8d35b4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:39.931366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3fab1980-b60b-4d11-b04c-53101e8d35b4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:39.931879 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3fab1980-b60b-4d11-b04c-53101e8d35b4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:39.933229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3fab1980-b60b-4d11-b04c-53101e8d35b4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:39.933723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3fab1980-b60b-4d11-b04c-53101e8d35b4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:40.149509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3fab1980-b60b-4d11-b04c-53101e8d35b4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:40.159666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3fab1980-b60b-4d11-b04c-53101e8d35b4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245513 Dec 21 04:13:40.160744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 532/1104] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:39 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:41.186431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9c572b86-cd80-45a2-92db-d7f0ef812bc1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:41.187055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9c572b86-cd80-45a2-92db-d7f0ef812bc1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:41.194846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c572b86-cd80-45a2-92db-d7f0ef812bc1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:41.195378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c572b86-cd80-45a2-92db-d7f0ef812bc1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:41.196195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c572b86-cd80-45a2-92db-d7f0ef812bc1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:41.196689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9c572b86-cd80-45a2-92db-d7f0ef812bc1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:41.413717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9c572b86-cd80-45a2-92db-d7f0ef812bc1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:41.422614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9c572b86-cd80-45a2-92db-d7f0ef812bc1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245499 Dec 21 04:13:41.423231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 573/1105] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:41 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:42.445951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5c875dcb-beb6-4abf-9100-7a61c9f5c0b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:42.446617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5c875dcb-beb6-4abf-9100-7a61c9f5c0b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:42.456763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5c875dcb-beb6-4abf-9100-7a61c9f5c0b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:42.457802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5c875dcb-beb6-4abf-9100-7a61c9f5c0b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:42.458953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5c875dcb-beb6-4abf-9100-7a61c9f5c0b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:42.459640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5c875dcb-beb6-4abf-9100-7a61c9f5c0b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:42.676191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5c875dcb-beb6-4abf-9100-7a61c9f5c0b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:42.685118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5c875dcb-beb6-4abf-9100-7a61c9f5c0b9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248320 Dec 21 04:13:42.685713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 533/1106] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:42 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:43.708359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5d39b9c0-55bc-4f17-ae5f-4cfe2e791e04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:43.709017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5d39b9c0-55bc-4f17-ae5f-4cfe2e791e04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:43.717448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d39b9c0-55bc-4f17-ae5f-4cfe2e791e04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:43.717949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d39b9c0-55bc-4f17-ae5f-4cfe2e791e04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:43.718768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d39b9c0-55bc-4f17-ae5f-4cfe2e791e04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:43.719282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d39b9c0-55bc-4f17-ae5f-4cfe2e791e04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:44.082488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5d39b9c0-55bc-4f17-ae5f-4cfe2e791e04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:44.092034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5d39b9c0-55bc-4f17-ae5f-4cfe2e791e04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.392729 Dec 21 04:13:44.092626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 574/1107] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:43 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:45.116088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c1616991-95c0-4d5d-a72c-b074d6272b5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:45.116747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c1616991-95c0-4d5d-a72c-b074d6272b5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:45.124758 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1616991-95c0-4d5d-a72c-b074d6272b5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:45.125265 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1616991-95c0-4d5d-a72c-b074d6272b5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:45.126089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1616991-95c0-4d5d-a72c-b074d6272b5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:45.126581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1616991-95c0-4d5d-a72c-b074d6272b5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:45.361264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c1616991-95c0-4d5d-a72c-b074d6272b5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:45.370439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c1616991-95c0-4d5d-a72c-b074d6272b5c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.263529 Dec 21 04:13:45.371050 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 534/1108] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:45 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:46.078134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:13:46.078500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:13:46 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:13:46.404787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e721b121-aa79-4d8d-96a2-ddfa30563030 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:46.405462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e721b121-aa79-4d8d-96a2-ddfa30563030 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:46.413442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e721b121-aa79-4d8d-96a2-ddfa30563030 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:46.413950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e721b121-aa79-4d8d-96a2-ddfa30563030 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:46.414792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e721b121-aa79-4d8d-96a2-ddfa30563030 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:46.415307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e721b121-aa79-4d8d-96a2-ddfa30563030 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:46.632972 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e721b121-aa79-4d8d-96a2-ddfa30563030 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:46.642466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e721b121-aa79-4d8d-96a2-ddfa30563030 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.257913 Dec 21 04:13:46.643283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 575/1109] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:46 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:47.665770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4a148a22-1463-4b1a-bb34-8c0008411c06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:47.666431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4a148a22-1463-4b1a-bb34-8c0008411c06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:47.675991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4a148a22-1463-4b1a-bb34-8c0008411c06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:47.676504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4a148a22-1463-4b1a-bb34-8c0008411c06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:47.677345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4a148a22-1463-4b1a-bb34-8c0008411c06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:47.677839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4a148a22-1463-4b1a-bb34-8c0008411c06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:47.893411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4a148a22-1463-4b1a-bb34-8c0008411c06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:47.903130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4a148a22-1463-4b1a-bb34-8c0008411c06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246362 Dec 21 04:13:47.903723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 535/1110] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:47 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:48.927269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5a385d53-f47a-43dd-840d-9b84a6c68bbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:48.927871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5a385d53-f47a-43dd-840d-9b84a6c68bbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:48.935768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a385d53-f47a-43dd-840d-9b84a6c68bbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:48.936269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a385d53-f47a-43dd-840d-9b84a6c68bbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:48.937151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a385d53-f47a-43dd-840d-9b84a6c68bbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:48.937641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a385d53-f47a-43dd-840d-9b84a6c68bbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:49.152497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5a385d53-f47a-43dd-840d-9b84a6c68bbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:49.161449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5a385d53-f47a-43dd-840d-9b84a6c68bbd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.243501 Dec 21 04:13:49.162034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 576/1111] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:48 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:50.186381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8e4d01a3-d0ee-44f1-b93a-d307f0ef651d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:50.186854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8e4d01a3-d0ee-44f1-b93a-d307f0ef651d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:50.194715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e4d01a3-d0ee-44f1-b93a-d307f0ef651d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:50.195258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e4d01a3-d0ee-44f1-b93a-d307f0ef651d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:50.196100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e4d01a3-d0ee-44f1-b93a-d307f0ef651d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:50.196601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e4d01a3-d0ee-44f1-b93a-d307f0ef651d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:50.425114 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8e4d01a3-d0ee-44f1-b93a-d307f0ef651d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:50.434076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8e4d01a3-d0ee-44f1-b93a-d307f0ef651d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.257709 Dec 21 04:13:50.434669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 536/1112] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:50 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:51.458376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4cf04e1c-fcbb-4dad-a8bc-93d8dc3097d6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:51.459087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4cf04e1c-fcbb-4dad-a8bc-93d8dc3097d6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:51.467435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4cf04e1c-fcbb-4dad-a8bc-93d8dc3097d6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:51.467888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4cf04e1c-fcbb-4dad-a8bc-93d8dc3097d6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:51.468791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4cf04e1c-fcbb-4dad-a8bc-93d8dc3097d6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:51.469293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4cf04e1c-fcbb-4dad-a8bc-93d8dc3097d6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:51.708317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4cf04e1c-fcbb-4dad-a8bc-93d8dc3097d6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:51.717299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4cf04e1c-fcbb-4dad-a8bc-93d8dc3097d6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.268592 Dec 21 04:13:51.717946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 577/1113] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:51 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:52.740705 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-eafa285d-5173-4869-b807-ff4a070ff681 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:52.741632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-eafa285d-5173-4869-b807-ff4a070ff681 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:52.750127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eafa285d-5173-4869-b807-ff4a070ff681 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:52.750635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eafa285d-5173-4869-b807-ff4a070ff681 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:52.751503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eafa285d-5173-4869-b807-ff4a070ff681 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:52.751998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eafa285d-5173-4869-b807-ff4a070ff681 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:52.973936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-eafa285d-5173-4869-b807-ff4a070ff681 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:52.983624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-eafa285d-5173-4869-b807-ff4a070ff681 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.252005 Dec 21 04:13:52.984210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 537/1114] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:52 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:54.008159 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2c5f91c3-30a5-4de8-8df1-a1b5ca6ca045 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:54.008835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2c5f91c3-30a5-4de8-8df1-a1b5ca6ca045 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:54.016562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dca63194-cb64-420f-b69a-f6c254fed282] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 21 04:13:54.018302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2c5f91c3-30a5-4de8-8df1-a1b5ca6ca045 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:54.018816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2c5f91c3-30a5-4de8-8df1-a1b5ca6ca045 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:54.019700 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2c5f91c3-30a5-4de8-8df1-a1b5ca6ca045 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:54.020194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2c5f91c3-30a5-4de8-8df1-a1b5ca6ca045 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:54.250603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2c5f91c3-30a5-4de8-8df1-a1b5ca6ca045 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:54.260641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2c5f91c3-30a5-4de8-8df1-a1b5ca6ca045 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.262152 Dec 21 04:13:54.261291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 578/1115] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:53 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:55.284691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5daf248d-8cce-4763-a47c-4b5ec7cef0aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:55.285356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5daf248d-8cce-4763-a47c-4b5ec7cef0aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:55.293309 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5daf248d-8cce-4763-a47c-4b5ec7cef0aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:55.293813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5daf248d-8cce-4763-a47c-4b5ec7cef0aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:55.294644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5daf248d-8cce-4763-a47c-4b5ec7cef0aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:55.295168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5daf248d-8cce-4763-a47c-4b5ec7cef0aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:55.516520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5daf248d-8cce-4763-a47c-4b5ec7cef0aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:55.525353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5daf248d-8cce-4763-a47c-4b5ec7cef0aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.250546 Dec 21 04:13:55.525937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 538/1116] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:55 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:56.550102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e402de6c-488d-4837-b5b7-44e3096e1404 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:56.550772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e402de6c-488d-4837-b5b7-44e3096e1404 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:56.569947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e402de6c-488d-4837-b5b7-44e3096e1404 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:56.570461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e402de6c-488d-4837-b5b7-44e3096e1404 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:56.571326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e402de6c-488d-4837-b5b7-44e3096e1404 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:56.571820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e402de6c-488d-4837-b5b7-44e3096e1404 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:56.626431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] [dca63194-cb64-420f-b69a-f6c254fed282] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55836. Dec 21 04:13:56.790503 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e402de6c-488d-4837-b5b7-44e3096e1404 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:56.800064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e402de6c-488d-4837-b5b7-44e3096e1404 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.259582 Dec 21 04:13:56.800658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 579/1117] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:56 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:57.824150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bad9f717-4b53-4ee4-9a9c-46b57e57a522 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:57.824814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bad9f717-4b53-4ee4-9a9c-46b57e57a522 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:57.832762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bad9f717-4b53-4ee4-9a9c-46b57e57a522 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:57.833270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bad9f717-4b53-4ee4-9a9c-46b57e57a522 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:57.834813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bad9f717-4b53-4ee4-9a9c-46b57e57a522 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:57.835362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bad9f717-4b53-4ee4-9a9c-46b57e57a522 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:58.052313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bad9f717-4b53-4ee4-9a9c-46b57e57a522 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:58.061374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bad9f717-4b53-4ee4-9a9c-46b57e57a522 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246448 Dec 21 04:13:58.061959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 539/1118] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:57 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:13:59.084700 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d66fd793-272a-4cc7-b124-84fd286422d0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:13:59.085413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d66fd793-272a-4cc7-b124-84fd286422d0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:13:59.093294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d66fd793-272a-4cc7-b124-84fd286422d0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:59.093798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d66fd793-272a-4cc7-b124-84fd286422d0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:59.094631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d66fd793-272a-4cc7-b124-84fd286422d0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:13:59.095158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d66fd793-272a-4cc7-b124-84fd286422d0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:13:59.319802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d66fd793-272a-4cc7-b124-84fd286422d0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:13:59.329041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d66fd793-272a-4cc7-b124-84fd286422d0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.253429 Dec 21 04:13:59.329646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 580/1119] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:13:59 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:00.352891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-edd748c0-2c7a-4d88-9e58-d1273319eb98 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:00.353562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-edd748c0-2c7a-4d88-9e58-d1273319eb98 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:00.361871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-edd748c0-2c7a-4d88-9e58-d1273319eb98 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:00.362385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-edd748c0-2c7a-4d88-9e58-d1273319eb98 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:00.363249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-edd748c0-2c7a-4d88-9e58-d1273319eb98 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:00.363745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-edd748c0-2c7a-4d88-9e58-d1273319eb98 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:00.587060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-edd748c0-2c7a-4d88-9e58-d1273319eb98 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:00.597417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-edd748c0-2c7a-4d88-9e58-d1273319eb98 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.253559 Dec 21 04:14:00.598029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 540/1120] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:00 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:01.621905 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0a75ad5a-3c0c-40d4-ac13-370e33aed50c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:01.622573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0a75ad5a-3c0c-40d4-ac13-370e33aed50c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:01.630452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a75ad5a-3c0c-40d4-ac13-370e33aed50c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:01.630976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a75ad5a-3c0c-40d4-ac13-370e33aed50c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:01.631806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a75ad5a-3c0c-40d4-ac13-370e33aed50c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:01.632295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a75ad5a-3c0c-40d4-ac13-370e33aed50c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:01.856908 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0a75ad5a-3c0c-40d4-ac13-370e33aed50c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:01.865750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0a75ad5a-3c0c-40d4-ac13-370e33aed50c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.253760 Dec 21 04:14:01.866592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 581/1121] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:01 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:02.890949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-de1257e2-3860-4a68-943a-e6842ab1de11 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:02.891603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-de1257e2-3860-4a68-943a-e6842ab1de11 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:02.899525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de1257e2-3860-4a68-943a-e6842ab1de11 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:02.900039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de1257e2-3860-4a68-943a-e6842ab1de11 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:02.900873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de1257e2-3860-4a68-943a-e6842ab1de11 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:02.902019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de1257e2-3860-4a68-943a-e6842ab1de11 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:03.117759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-de1257e2-3860-4a68-943a-e6842ab1de11 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:03.127133 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-de1257e2-3860-4a68-943a-e6842ab1de11 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246315 Dec 21 04:14:03.127723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 541/1122] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:02 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:04.151126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e5382b3d-2fe5-4bdb-b842-d67bc43c150e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:04.152411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e5382b3d-2fe5-4bdb-b842-d67bc43c150e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:04.160281 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5382b3d-2fe5-4bdb-b842-d67bc43c150e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:04.160793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5382b3d-2fe5-4bdb-b842-d67bc43c150e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:04.161621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5382b3d-2fe5-4bdb-b842-d67bc43c150e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:04.162114 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5382b3d-2fe5-4bdb-b842-d67bc43c150e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:04.386030 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e5382b3d-2fe5-4bdb-b842-d67bc43c150e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:04.394958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e5382b3d-2fe5-4bdb-b842-d67bc43c150e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.253067 Dec 21 04:14:04.395586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 582/1123] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:04 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:05.419128 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a98bae1d-bcc7-423e-9b67-634a9d9308d1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:05.419737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a98bae1d-bcc7-423e-9b67-634a9d9308d1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:05.428668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a98bae1d-bcc7-423e-9b67-634a9d9308d1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:05.429181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a98bae1d-bcc7-423e-9b67-634a9d9308d1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:05.430023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a98bae1d-bcc7-423e-9b67-634a9d9308d1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:05.430508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a98bae1d-bcc7-423e-9b67-634a9d9308d1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:05.730799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a98bae1d-bcc7-423e-9b67-634a9d9308d1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:05.739681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a98bae1d-bcc7-423e-9b67-634a9d9308d1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.329831 Dec 21 04:14:05.740272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 542/1124] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:05 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:06.764044 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c016d155-f652-48a2-91bf-e4b0144baab5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:06.764718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c016d155-f652-48a2-91bf-e4b0144baab5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:06.772628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c016d155-f652-48a2-91bf-e4b0144baab5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:06.773133 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c016d155-f652-48a2-91bf-e4b0144baab5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:06.773956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c016d155-f652-48a2-91bf-e4b0144baab5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:06.774447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c016d155-f652-48a2-91bf-e4b0144baab5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:07.074250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c016d155-f652-48a2-91bf-e4b0144baab5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:07.083224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c016d155-f652-48a2-91bf-e4b0144baab5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.328399 Dec 21 04:14:07.083830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 583/1125] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:06 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:08.107802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c1409a8a-7d28-4665-b5de-18a8adcf40a9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:08.108509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c1409a8a-7d28-4665-b5de-18a8adcf40a9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:08.116605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1409a8a-7d28-4665-b5de-18a8adcf40a9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:08.117117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1409a8a-7d28-4665-b5de-18a8adcf40a9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:08.117945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1409a8a-7d28-4665-b5de-18a8adcf40a9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:08.118432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c1409a8a-7d28-4665-b5de-18a8adcf40a9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:08.343348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c1409a8a-7d28-4665-b5de-18a8adcf40a9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:08.352310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c1409a8a-7d28-4665-b5de-18a8adcf40a9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.254507 Dec 21 04:14:08.352914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 543/1126] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:08 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:09.377113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-db07696b-bb56-4165-ba3d-027d01df070e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:09.377735 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-db07696b-bb56-4165-ba3d-027d01df070e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:09.386225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-db07696b-bb56-4165-ba3d-027d01df070e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:09.386740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-db07696b-bb56-4165-ba3d-027d01df070e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:09.387636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-db07696b-bb56-4165-ba3d-027d01df070e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:09.388138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-db07696b-bb56-4165-ba3d-027d01df070e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:09.608914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-db07696b-bb56-4165-ba3d-027d01df070e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:09.618100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-db07696b-bb56-4165-ba3d-027d01df070e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.250747 Dec 21 04:14:09.618930 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 584/1127] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:09 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:10.640376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6175ae4d-f9f6-46d7-b0b1-c05218e34bf6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:10.641035 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6175ae4d-f9f6-46d7-b0b1-c05218e34bf6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:10.648854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6175ae4d-f9f6-46d7-b0b1-c05218e34bf6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:10.649356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6175ae4d-f9f6-46d7-b0b1-c05218e34bf6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:10.650182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6175ae4d-f9f6-46d7-b0b1-c05218e34bf6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:10.650670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6175ae4d-f9f6-46d7-b0b1-c05218e34bf6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:10.869168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6175ae4d-f9f6-46d7-b0b1-c05218e34bf6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:10.878653 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6175ae4d-f9f6-46d7-b0b1-c05218e34bf6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247328 Dec 21 04:14:10.879283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 544/1128] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:10 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:11.901443 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a97d066e-28fa-4010-945b-85441c70cb3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:11.902115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a97d066e-28fa-4010-945b-85441c70cb3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:11.909977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a97d066e-28fa-4010-945b-85441c70cb3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:11.910487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a97d066e-28fa-4010-945b-85441c70cb3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:11.911349 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a97d066e-28fa-4010-945b-85441c70cb3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:11.911846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a97d066e-28fa-4010-945b-85441c70cb3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:12.126778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a97d066e-28fa-4010-945b-85441c70cb3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:12.135932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a97d066e-28fa-4010-945b-85441c70cb3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.243465 Dec 21 04:14:12.136537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 585/1129] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:11 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:13.159033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8364fa85-7873-4710-be2d-949bef43e7aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:13.159914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8364fa85-7873-4710-be2d-949bef43e7aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:13.168559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8364fa85-7873-4710-be2d-949bef43e7aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:13.169058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8364fa85-7873-4710-be2d-949bef43e7aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:13.169889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8364fa85-7873-4710-be2d-949bef43e7aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:13.170379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8364fa85-7873-4710-be2d-949bef43e7aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:13.396549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8364fa85-7873-4710-be2d-949bef43e7aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:13.405535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8364fa85-7873-4710-be2d-949bef43e7aa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.255589 Dec 21 04:14:13.406132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 545/1130] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:13 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:14.428950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5874e1c6-1aa4-4182-b8aa-79d08124fc15 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:14.429546 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5874e1c6-1aa4-4182-b8aa-79d08124fc15 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:14.437886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5874e1c6-1aa4-4182-b8aa-79d08124fc15 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:14.438389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5874e1c6-1aa4-4182-b8aa-79d08124fc15 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:14.439299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5874e1c6-1aa4-4182-b8aa-79d08124fc15 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:14.439910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5874e1c6-1aa4-4182-b8aa-79d08124fc15 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:14.664087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5874e1c6-1aa4-4182-b8aa-79d08124fc15 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:14.673576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5874e1c6-1aa4-4182-b8aa-79d08124fc15 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.253889 Dec 21 04:14:14.674151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 586/1131] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:14 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:15.697575 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ff37622e-6d67-4ce9-853e-6bea85cfa8ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:15.698730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ff37622e-6d67-4ce9-853e-6bea85cfa8ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:15.706563 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ff37622e-6d67-4ce9-853e-6bea85cfa8ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:15.707126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ff37622e-6d67-4ce9-853e-6bea85cfa8ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:15.707960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ff37622e-6d67-4ce9-853e-6bea85cfa8ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:15.708453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ff37622e-6d67-4ce9-853e-6bea85cfa8ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:15.926886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ff37622e-6d67-4ce9-853e-6bea85cfa8ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:15.936399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ff37622e-6d67-4ce9-853e-6bea85cfa8ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248058 Dec 21 04:14:15.936987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 546/1132] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:15 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:16.959456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8095ed0c-237b-462f-b3bd-227f4825f765 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:16.960127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8095ed0c-237b-462f-b3bd-227f4825f765 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:16.969007 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8095ed0c-237b-462f-b3bd-227f4825f765 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:16.969741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8095ed0c-237b-462f-b3bd-227f4825f765 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:16.970620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8095ed0c-237b-462f-b3bd-227f4825f765 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:16.971186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8095ed0c-237b-462f-b3bd-227f4825f765 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:17.193146 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8095ed0c-237b-462f-b3bd-227f4825f765 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:17.202757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8095ed0c-237b-462f-b3bd-227f4825f765 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.252493 Dec 21 04:14:17.203387 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 587/1133] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:16 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:18.226960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6f859a76-de50-4741-9c15-c2570d4cd86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:18.227638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6f859a76-de50-4741-9c15-c2570d4cd86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:18.236432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f859a76-de50-4741-9c15-c2570d4cd86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:18.236944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f859a76-de50-4741-9c15-c2570d4cd86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:18.237785 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f859a76-de50-4741-9c15-c2570d4cd86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:18.238282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f859a76-de50-4741-9c15-c2570d4cd86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:18.661406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6f859a76-de50-4741-9c15-c2570d4cd86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:18.670205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6f859a76-de50-4741-9c15-c2570d4cd86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.453478 Dec 21 04:14:18.670777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 547/1134] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:18 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:19.693851 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-18738a10-d123-4bc7-adf8-ff106b7a74a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:19.694462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-18738a10-d123-4bc7-adf8-ff106b7a74a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:19.702378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18738a10-d123-4bc7-adf8-ff106b7a74a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:19.702891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18738a10-d123-4bc7-adf8-ff106b7a74a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:19.703767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18738a10-d123-4bc7-adf8-ff106b7a74a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:19.704263 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18738a10-d123-4bc7-adf8-ff106b7a74a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:19.918633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-18738a10-d123-4bc7-adf8-ff106b7a74a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:19.927586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-18738a10-d123-4bc7-adf8-ff106b7a74a8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.242906 Dec 21 04:14:19.928189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 588/1135] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:19 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:20.950978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-feb6d431-e52b-4da1-9f44-83b8bd8f7c90 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:20.951593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-feb6d431-e52b-4da1-9f44-83b8bd8f7c90 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:20.959707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-feb6d431-e52b-4da1-9f44-83b8bd8f7c90 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:20.960266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-feb6d431-e52b-4da1-9f44-83b8bd8f7c90 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:20.961100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-feb6d431-e52b-4da1-9f44-83b8bd8f7c90 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:20.961594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-feb6d431-e52b-4da1-9f44-83b8bd8f7c90 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:21.176741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-feb6d431-e52b-4da1-9f44-83b8bd8f7c90 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:21.185827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-feb6d431-e52b-4da1-9f44-83b8bd8f7c90 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.244119 Dec 21 04:14:21.186412 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 548/1136] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:20 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:22.209411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-16e51517-a923-44d6-87ab-450764c31e3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:22.210074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-16e51517-a923-44d6-87ab-450764c31e3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:22.217892 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16e51517-a923-44d6-87ab-450764c31e3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:22.218398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16e51517-a923-44d6-87ab-450764c31e3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:22.219247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16e51517-a923-44d6-87ab-450764c31e3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:22.219738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16e51517-a923-44d6-87ab-450764c31e3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:22.442181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-16e51517-a923-44d6-87ab-450764c31e3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:22.451298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-16e51517-a923-44d6-87ab-450764c31e3c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.251045 Dec 21 04:14:22.452091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 589/1137] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:22 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:23.475085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fc365d0d-cd91-43d4-bfac-3bc4ca45b6f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:23.475740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fc365d0d-cd91-43d4-bfac-3bc4ca45b6f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:23.484613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc365d0d-cd91-43d4-bfac-3bc4ca45b6f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:23.486359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc365d0d-cd91-43d4-bfac-3bc4ca45b6f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:23.487357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc365d0d-cd91-43d4-bfac-3bc4ca45b6f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:23.487865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fc365d0d-cd91-43d4-bfac-3bc4ca45b6f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:23.551179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d3a22ec2-b148-4c7c-987b-babc6673ba79 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:23.551832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d3a22ec2-b148-4c7c-987b-babc6673ba79 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:23.560344 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3a22ec2-b148-4c7c-987b-babc6673ba79 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:23.560850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3a22ec2-b148-4c7c-987b-babc6673ba79 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:23.561683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3a22ec2-b148-4c7c-987b-babc6673ba79 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:23.562178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3a22ec2-b148-4c7c-987b-babc6673ba79 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:23.714439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fc365d0d-cd91-43d4-bfac-3bc4ca45b6f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:23.723583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fc365d0d-cd91-43d4-bfac-3bc4ca45b6f8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.257935 Dec 21 04:14:23.724161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 549/1138] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:23 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:23.849964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d3a22ec2-b148-4c7c-987b-babc6673ba79 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "DELETE /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e/os-volume_attachments/9b65963f-29b3-413e-a7b5-0b29b016b00b" status: 202 len: 0 microversion: 2.1 time: 0.307849 Dec 21 04:14:23.854273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 590/1139] 10.222.0.16 () {58 vars in 1406 bytes} [Mon Dec 21 04:14:23 2020] DELETE /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e/os-volume_attachments/9b65963f-29b3-413e-a7b5-0b29b016b00b => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 21 04:14:24.748316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d157fa65-7b4f-471e-91a1-27170ca5d454 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:24.748988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d157fa65-7b4f-471e-91a1-27170ca5d454 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:24.756895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d157fa65-7b4f-471e-91a1-27170ca5d454 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:24.757414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d157fa65-7b4f-471e-91a1-27170ca5d454 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:24.758256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d157fa65-7b4f-471e-91a1-27170ca5d454 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:24.758755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d157fa65-7b4f-471e-91a1-27170ca5d454 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:24.980819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d157fa65-7b4f-471e-91a1-27170ca5d454 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:24.989660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d157fa65-7b4f-471e-91a1-27170ca5d454 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.251226 Dec 21 04:14:24.990252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 550/1140] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:24 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:26.016601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-861a0b92-31bc-4021-b0ac-a86dc0590ff9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:26.016601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-861a0b92-31bc-4021-b0ac-a86dc0590ff9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:26.023758 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-861a0b92-31bc-4021-b0ac-a86dc0590ff9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:26.024329 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-861a0b92-31bc-4021-b0ac-a86dc0590ff9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:26.025127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-861a0b92-31bc-4021-b0ac-a86dc0590ff9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:26.025628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-861a0b92-31bc-4021-b0ac-a86dc0590ff9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:26.268298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-861a0b92-31bc-4021-b0ac-a86dc0590ff9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:26.278237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-861a0b92-31bc-4021-b0ac-a86dc0590ff9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.274041 Dec 21 04:14:26.278882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 591/1141] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:26 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:27.318811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-307764ba-771b-4ca3-9f7f-03307a5af561 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:27.319603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-307764ba-771b-4ca3-9f7f-03307a5af561 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:27.330844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-307764ba-771b-4ca3-9f7f-03307a5af561 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:27.333482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-307764ba-771b-4ca3-9f7f-03307a5af561 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:27.334444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-307764ba-771b-4ca3-9f7f-03307a5af561 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:27.334982 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-307764ba-771b-4ca3-9f7f-03307a5af561 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:27.652739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-307764ba-771b-4ca3-9f7f-03307a5af561 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:27.662339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-307764ba-771b-4ca3-9f7f-03307a5af561 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.369769 Dec 21 04:14:27.663112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 551/1142] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:27 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:28.686213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-33942e2b-09c3-40b7-aa54-15409d799bc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:28.687934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-33942e2b-09c3-40b7-aa54-15409d799bc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:28.697944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-33942e2b-09c3-40b7-aa54-15409d799bc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:28.699460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-33942e2b-09c3-40b7-aa54-15409d799bc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:28.701692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-33942e2b-09c3-40b7-aa54-15409d799bc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:28.702720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-33942e2b-09c3-40b7-aa54-15409d799bc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:28.951340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-33942e2b-09c3-40b7-aa54-15409d799bc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:28.960817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-33942e2b-09c3-40b7-aa54-15409d799bc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.283897 Dec 21 04:14:28.961663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 592/1143] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:28 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:29.987952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c4fc4ad9-18aa-40ce-b95f-8a7e945e764f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:29.989938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c4fc4ad9-18aa-40ce-b95f-8a7e945e764f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:29.999855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c4fc4ad9-18aa-40ce-b95f-8a7e945e764f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:30.000374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c4fc4ad9-18aa-40ce-b95f-8a7e945e764f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:30.001362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c4fc4ad9-18aa-40ce-b95f-8a7e945e764f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:30.001868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c4fc4ad9-18aa-40ce-b95f-8a7e945e764f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:30.257358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c4fc4ad9-18aa-40ce-b95f-8a7e945e764f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:30.266350 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c4fc4ad9-18aa-40ce-b95f-8a7e945e764f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.289725 Dec 21 04:14:30.266945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 552/1144] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:29 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:31.290363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bc410631-f657-4c7f-9a67-2235d1130d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:31.291698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bc410631-f657-4c7f-9a67-2235d1130d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:31.300208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc410631-f657-4c7f-9a67-2235d1130d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:31.300717 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc410631-f657-4c7f-9a67-2235d1130d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:31.301549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc410631-f657-4c7f-9a67-2235d1130d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:31.302045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bc410631-f657-4c7f-9a67-2235d1130d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:31.528185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bc410631-f657-4c7f-9a67-2235d1130d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:31.537168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bc410631-f657-4c7f-9a67-2235d1130d6f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.255955 Dec 21 04:14:31.537770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 593/1145] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:31 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:32.561864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e52b4575-8175-4635-9455-daae36fcd4fa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:32.562528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e52b4575-8175-4635-9455-daae36fcd4fa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:32.570416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e52b4575-8175-4635-9455-daae36fcd4fa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:32.570984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e52b4575-8175-4635-9455-daae36fcd4fa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:32.571824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e52b4575-8175-4635-9455-daae36fcd4fa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:32.572988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e52b4575-8175-4635-9455-daae36fcd4fa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:32.802174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e52b4575-8175-4635-9455-daae36fcd4fa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:32.813696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e52b4575-8175-4635-9455-daae36fcd4fa tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.261323 Dec 21 04:14:32.814553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 553/1146] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:32 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:14:33.839180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ab580504-3d64-49b2-9127-eb3bdcf2e676 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:33.839852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ab580504-3d64-49b2-9127-eb3bdcf2e676 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:33.847769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ab580504-3d64-49b2-9127-eb3bdcf2e676 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:33.848276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ab580504-3d64-49b2-9127-eb3bdcf2e676 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:33.849213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ab580504-3d64-49b2-9127-eb3bdcf2e676 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:33.849606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ab580504-3d64-49b2-9127-eb3bdcf2e676 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:34.309280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ab580504-3d64-49b2-9127-eb3bdcf2e676 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:34.318568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ab580504-3d64-49b2-9127-eb3bdcf2e676 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.489113 Dec 21 04:14:34.319213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 594/1147] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:33 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:35.343669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4eaecfd7-286f-4c2f-ba26-e11f7b086dc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:35.344705 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4eaecfd7-286f-4c2f-ba26-e11f7b086dc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:35.350677 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27fe5106-18ea-44c6-8644-655b910d6119] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 21 04:14:35.355628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4eaecfd7-286f-4c2f-ba26-e11f7b086dc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:35.356147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4eaecfd7-286f-4c2f-ba26-e11f7b086dc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:35.357003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4eaecfd7-286f-4c2f-ba26-e11f7b086dc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:35.357508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4eaecfd7-286f-4c2f-ba26-e11f7b086dc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:35.610110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4eaecfd7-286f-4c2f-ba26-e11f7b086dc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:35.621113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4eaecfd7-286f-4c2f-ba26-e11f7b086dc6 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.287851 Dec 21 04:14:35.622041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 554/1148] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:35 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:36.644754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0b13f60b-5024-46b1-9e6c-d4f9e399aa6b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:36.645976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0b13f60b-5024-46b1-9e6c-d4f9e399aa6b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:36.654295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0b13f60b-5024-46b1-9e6c-d4f9e399aa6b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:36.655220 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0b13f60b-5024-46b1-9e6c-d4f9e399aa6b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:36.656247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0b13f60b-5024-46b1-9e6c-d4f9e399aa6b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:36.656881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0b13f60b-5024-46b1-9e6c-d4f9e399aa6b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:36.911090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0b13f60b-5024-46b1-9e6c-d4f9e399aa6b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:36.919886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0b13f60b-5024-46b1-9e6c-d4f9e399aa6b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.284084 Dec 21 04:14:36.920493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 595/1149] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:36 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:37.944078 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0fefbab4-6824-4cf4-ba1e-263bb1438086 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:37.944723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0fefbab4-6824-4cf4-ba1e-263bb1438086 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:37.964067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0fefbab4-6824-4cf4-ba1e-263bb1438086 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:37.964577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0fefbab4-6824-4cf4-ba1e-263bb1438086 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:37.965415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0fefbab4-6824-4cf4-ba1e-263bb1438086 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:37.966685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0fefbab4-6824-4cf4-ba1e-263bb1438086 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:38.030910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] [27fe5106-18ea-44c6-8644-655b910d6119] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56588. Dec 21 04:14:38.244844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0fefbab4-6824-4cf4-ba1e-263bb1438086 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:38.256465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0fefbab4-6824-4cf4-ba1e-263bb1438086 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.321817 Dec 21 04:14:38.257300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 555/1150] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:37 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:39.280573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-76d028a0-b6b3-45a2-bdcb-47d92d2a6008 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:39.281243 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-76d028a0-b6b3-45a2-bdcb-47d92d2a6008 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:39.289140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76d028a0-b6b3-45a2-bdcb-47d92d2a6008 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:39.289703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76d028a0-b6b3-45a2-bdcb-47d92d2a6008 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:39.290487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76d028a0-b6b3-45a2-bdcb-47d92d2a6008 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:39.291062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76d028a0-b6b3-45a2-bdcb-47d92d2a6008 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:39.509472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-76d028a0-b6b3-45a2-bdcb-47d92d2a6008 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:39.518351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-76d028a0-b6b3-45a2-bdcb-47d92d2a6008 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247189 Dec 21 04:14:39.518958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 596/1151] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:39 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:40.200273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3ed9f40f-4421-4e83-84aa-8be083b15745 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:40.200819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3ed9f40f-4421-4e83-84aa-8be083b15745 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:40.208803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ed9f40f-4421-4e83-84aa-8be083b15745 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:40.209288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ed9f40f-4421-4e83-84aa-8be083b15745 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:40.210113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ed9f40f-4421-4e83-84aa-8be083b15745 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:40.210605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ed9f40f-4421-4e83-84aa-8be083b15745 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:40.282879 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3ed9f40f-4421-4e83-84aa-8be083b15745 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Going to try to terminate instance {{(pid=94298) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:14:40.403676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3ed9f40f-4421-4e83-84aa-8be083b15745 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "DELETE /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 204 len: 0 microversion: 2.20 time: 0.212491 Dec 21 04:14:40.407860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 556/1152] 10.222.0.16 () {60 vars in 1270 bytes} [Mon Dec 21 04:14:40 2020] DELETE /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 21 04:14:40.419509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fee969ea-9b43-4c3d-b028-48686532fce3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:40.420705 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fee969ea-9b43-4c3d-b028-48686532fce3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:40.428629 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fee969ea-9b43-4c3d-b028-48686532fce3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:40.429130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fee969ea-9b43-4c3d-b028-48686532fce3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:40.429957 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fee969ea-9b43-4c3d-b028-48686532fce3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:40.430445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fee969ea-9b43-4c3d-b028-48686532fce3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:40.544804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8d55f37c-59c7-424f-8c52-6f7bf931b9bb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:40.545685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8d55f37c-59c7-424f-8c52-6f7bf931b9bb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:40.553776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d55f37c-59c7-424f-8c52-6f7bf931b9bb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:40.554380 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d55f37c-59c7-424f-8c52-6f7bf931b9bb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:40.555370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d55f37c-59c7-424f-8c52-6f7bf931b9bb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:40.555942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d55f37c-59c7-424f-8c52-6f7bf931b9bb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:40.655669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fee969ea-9b43-4c3d-b028-48686532fce3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:40.671863 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fee969ea-9b43-4c3d-b028-48686532fce3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:40.678423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fee969ea-9b43-4c3d-b028-48686532fce3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:40.679852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fee969ea-9b43-4c3d-b028-48686532fce3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1802 microversion: 2.20 time: 0.270310 Dec 21 04:14:40.680493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 597/1153] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:40 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1802 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:40.786449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8d55f37c-59c7-424f-8c52-6f7bf931b9bb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:40.796236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8d55f37c-59c7-424f-8c52-6f7bf931b9bb tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.263332 Dec 21 04:14:40.796831 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 557/1154] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:40 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:41.704886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-03e218e6-94bc-43ca-a74b-80d9fdcfc4ab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:41.705558 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-03e218e6-94bc-43ca-a74b-80d9fdcfc4ab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:41.713825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03e218e6-94bc-43ca-a74b-80d9fdcfc4ab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:41.714340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03e218e6-94bc-43ca-a74b-80d9fdcfc4ab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:41.715212 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03e218e6-94bc-43ca-a74b-80d9fdcfc4ab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:41.715714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03e218e6-94bc-43ca-a74b-80d9fdcfc4ab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:41.819299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2e354fc6-b960-4d94-a42b-dc4a13ba6dbe tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:41.820149 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2e354fc6-b960-4d94-a42b-dc4a13ba6dbe tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:41.828507 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e354fc6-b960-4d94-a42b-dc4a13ba6dbe tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:41.828994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e354fc6-b960-4d94-a42b-dc4a13ba6dbe tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:41.829833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e354fc6-b960-4d94-a42b-dc4a13ba6dbe tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:41.830319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e354fc6-b960-4d94-a42b-dc4a13ba6dbe tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:41.851838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-03e218e6-94bc-43ca-a74b-80d9fdcfc4ab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:41.867682 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-03e218e6-94bc-43ca-a74b-80d9fdcfc4ab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:41.876004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-03e218e6-94bc-43ca-a74b-80d9fdcfc4ab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:41.877588 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-03e218e6-94bc-43ca-a74b-80d9fdcfc4ab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1734 microversion: 2.20 time: 0.182000 Dec 21 04:14:41.877788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 598/1155] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:41 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:42.511898 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2e354fc6-b960-4d94-a42b-dc4a13ba6dbe tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:42.522320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2e354fc6-b960-4d94-a42b-dc4a13ba6dbe tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.712170 Dec 21 04:14:42.523482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 558/1156] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:41 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:42.903241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-293cae44-c277-416f-b5f9-0ddda7241336 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:42.905391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-293cae44-c277-416f-b5f9-0ddda7241336 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:42.913695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-293cae44-c277-416f-b5f9-0ddda7241336 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:42.914460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-293cae44-c277-416f-b5f9-0ddda7241336 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:42.915691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-293cae44-c277-416f-b5f9-0ddda7241336 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:42.916871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-293cae44-c277-416f-b5f9-0ddda7241336 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:42.981674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-6d0fd2cf-47bc-4fd8-8cbb-5c9f944bd192 req-6c528a2a-ee26-4278-8901-5343099b009c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37226a3f-240e-4e04-9813-fa3d109452de", "name": "network-vif-deleted", "tag": "cebf23f8-0aba-463b-89c6-d9e38a717d77"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:14:42.988647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:42.988647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:14:42.998816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-6d0fd2cf-47bc-4fd8-8cbb-5c9f944bd192 req-6c528a2a-ee26-4278-8901-5343099b009c service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:42.999545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-6d0fd2cf-47bc-4fd8-8cbb-5c9f944bd192 req-6c528a2a-ee26-4278-8901-5343099b009c service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:43.017088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-6d0fd2cf-47bc-4fd8-8cbb-5c9f944bd192 req-6c528a2a-ee26-4278-8901-5343099b009c service nova] Creating event network-vif-deleted:cebf23f8-0aba-463b-89c6-d9e38a717d77 for instance 37226a3f-240e-4e04-9813-fa3d109452de on hv-cinder-73306 Dec 21 04:14:43.022148 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-6d0fd2cf-47bc-4fd8-8cbb-5c9f944bd192 req-6c528a2a-ee26-4278-8901-5343099b009c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228742 Dec 21 04:14:43.023023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 599/1157] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:14:42 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:14:43.069829 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-293cae44-c277-416f-b5f9-0ddda7241336 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:43.085010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-293cae44-c277-416f-b5f9-0ddda7241336 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:43.092854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-293cae44-c277-416f-b5f9-0ddda7241336 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:43.094045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-293cae44-c277-416f-b5f9-0ddda7241336 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.200696 Dec 21 04:14:43.094627 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 559/1158] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:42 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:43.552798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3aa9e35f-0757-402d-adf8-0e109f44180d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:43.553486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3aa9e35f-0757-402d-adf8-0e109f44180d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:43.562172 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3aa9e35f-0757-402d-adf8-0e109f44180d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:43.562673 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3aa9e35f-0757-402d-adf8-0e109f44180d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:43.563525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3aa9e35f-0757-402d-adf8-0e109f44180d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:43.564023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3aa9e35f-0757-402d-adf8-0e109f44180d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:43.795514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3aa9e35f-0757-402d-adf8-0e109f44180d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:43.804462 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3aa9e35f-0757-402d-adf8-0e109f44180d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.261566 Dec 21 04:14:43.805079 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 600/1159] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:43 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:44.119727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fd0106bf-7b6c-4520-8ad8-66e2c9745961 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:44.120382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fd0106bf-7b6c-4520-8ad8-66e2c9745961 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:44.128210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fd0106bf-7b6c-4520-8ad8-66e2c9745961 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:44.128714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fd0106bf-7b6c-4520-8ad8-66e2c9745961 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:44.129536 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fd0106bf-7b6c-4520-8ad8-66e2c9745961 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:44.130021 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fd0106bf-7b6c-4520-8ad8-66e2c9745961 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:44.265858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fd0106bf-7b6c-4520-8ad8-66e2c9745961 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:44.284193 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fd0106bf-7b6c-4520-8ad8-66e2c9745961 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:44.290661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fd0106bf-7b6c-4520-8ad8-66e2c9745961 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:44.291883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fd0106bf-7b6c-4520-8ad8-66e2c9745961 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.182116 Dec 21 04:14:44.292474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 560/1160] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:44 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:44.828535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9b2dd20b-3c3c-45d4-90df-60df8d9c764d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:44.829197 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9b2dd20b-3c3c-45d4-90df-60df8d9c764d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:44.837124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9b2dd20b-3c3c-45d4-90df-60df8d9c764d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:44.837751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9b2dd20b-3c3c-45d4-90df-60df8d9c764d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:44.838566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9b2dd20b-3c3c-45d4-90df-60df8d9c764d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:44.839089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9b2dd20b-3c3c-45d4-90df-60df8d9c764d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:45.058287 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9b2dd20b-3c3c-45d4-90df-60df8d9c764d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:45.067075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9b2dd20b-3c3c-45d4-90df-60df8d9c764d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247865 Dec 21 04:14:45.067665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 601/1161] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:44 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:45.316529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d83a6591-0c5a-4093-b7c8-8c553e1859d1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:45.317118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d83a6591-0c5a-4093-b7c8-8c553e1859d1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:45.325726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d83a6591-0c5a-4093-b7c8-8c553e1859d1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:45.326236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d83a6591-0c5a-4093-b7c8-8c553e1859d1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:45.327096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d83a6591-0c5a-4093-b7c8-8c553e1859d1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:45.327593 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d83a6591-0c5a-4093-b7c8-8c553e1859d1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:45.460958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d83a6591-0c5a-4093-b7c8-8c553e1859d1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:45.476003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d83a6591-0c5a-4093-b7c8-8c553e1859d1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:45.483260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d83a6591-0c5a-4093-b7c8-8c553e1859d1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:45.484416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d83a6591-0c5a-4093-b7c8-8c553e1859d1 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.177069 Dec 21 04:14:45.485011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 561/1162] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:45 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:46.090504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e1b81e53-54de-4160-a52e-8f027ac340c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:46.091194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e1b81e53-54de-4160-a52e-8f027ac340c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:46.099027 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e1b81e53-54de-4160-a52e-8f027ac340c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:46.099528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e1b81e53-54de-4160-a52e-8f027ac340c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:46.100346 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e1b81e53-54de-4160-a52e-8f027ac340c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:46.100831 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e1b81e53-54de-4160-a52e-8f027ac340c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:46.312842 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e1b81e53-54de-4160-a52e-8f027ac340c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:46.322163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e1b81e53-54de-4160-a52e-8f027ac340c2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.240904 Dec 21 04:14:46.322836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 602/1163] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:46 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:46.510663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a3eb387e-cf70-4424-8cc6-cc283d87f259 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:46.511311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a3eb387e-cf70-4424-8cc6-cc283d87f259 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:46.519334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a3eb387e-cf70-4424-8cc6-cc283d87f259 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:46.519854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a3eb387e-cf70-4424-8cc6-cc283d87f259 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:46.520685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a3eb387e-cf70-4424-8cc6-cc283d87f259 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:46.521176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a3eb387e-cf70-4424-8cc6-cc283d87f259 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:46.651131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a3eb387e-cf70-4424-8cc6-cc283d87f259 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:46.665896 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a3eb387e-cf70-4424-8cc6-cc283d87f259 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:46.672372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a3eb387e-cf70-4424-8cc6-cc283d87f259 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:46.673533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a3eb387e-cf70-4424-8cc6-cc283d87f259 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.172843 Dec 21 04:14:46.674124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 562/1164] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:46 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:47.346377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-eb35b309-e52f-4012-9180-3963bb18080c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:47.347076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-eb35b309-e52f-4012-9180-3963bb18080c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:47.355707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eb35b309-e52f-4012-9180-3963bb18080c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:47.356219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eb35b309-e52f-4012-9180-3963bb18080c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:47.357049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eb35b309-e52f-4012-9180-3963bb18080c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:47.357544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eb35b309-e52f-4012-9180-3963bb18080c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:47.573685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-eb35b309-e52f-4012-9180-3963bb18080c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:47.582456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-eb35b309-e52f-4012-9180-3963bb18080c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245830 Dec 21 04:14:47.583065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 603/1165] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:47 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:47.698853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5940e1ed-1b44-4a00-96a1-43f05dc24e0f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:47.699479 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5940e1ed-1b44-4a00-96a1-43f05dc24e0f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:47.707354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5940e1ed-1b44-4a00-96a1-43f05dc24e0f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:47.707865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5940e1ed-1b44-4a00-96a1-43f05dc24e0f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:47.708689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5940e1ed-1b44-4a00-96a1-43f05dc24e0f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:47.709185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5940e1ed-1b44-4a00-96a1-43f05dc24e0f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:47.983406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5940e1ed-1b44-4a00-96a1-43f05dc24e0f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:47.999045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5940e1ed-1b44-4a00-96a1-43f05dc24e0f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:48.005508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5940e1ed-1b44-4a00-96a1-43f05dc24e0f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:48.006670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5940e1ed-1b44-4a00-96a1-43f05dc24e0f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.317554 Dec 21 04:14:48.007294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 563/1166] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:47 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:14:48.606878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-76aa3bca-f110-4697-8789-b4a5cfb76f08 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:48.607501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-76aa3bca-f110-4697-8789-b4a5cfb76f08 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:48.615395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76aa3bca-f110-4697-8789-b4a5cfb76f08 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:48.615904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76aa3bca-f110-4697-8789-b4a5cfb76f08 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:48.616988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76aa3bca-f110-4697-8789-b4a5cfb76f08 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:48.617478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-76aa3bca-f110-4697-8789-b4a5cfb76f08 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:48.836597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-76aa3bca-f110-4697-8789-b4a5cfb76f08 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:48.845758 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-76aa3bca-f110-4697-8789-b4a5cfb76f08 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248134 Dec 21 04:14:48.846342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 604/1167] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:48 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:49.031336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-63125324-bef1-4a8d-87f1-c42cd9078666 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:49.032002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-63125324-bef1-4a8d-87f1-c42cd9078666 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:49.039835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-63125324-bef1-4a8d-87f1-c42cd9078666 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:49.040433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-63125324-bef1-4a8d-87f1-c42cd9078666 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:49.041400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-63125324-bef1-4a8d-87f1-c42cd9078666 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:49.041889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-63125324-bef1-4a8d-87f1-c42cd9078666 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:49.173517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-63125324-bef1-4a8d-87f1-c42cd9078666 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:49.188922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-63125324-bef1-4a8d-87f1-c42cd9078666 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:49.195472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-63125324-bef1-4a8d-87f1-c42cd9078666 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:49.196665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-63125324-bef1-4a8d-87f1-c42cd9078666 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.174608 Dec 21 04:14:49.197318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 564/1168] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:49 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:49.869291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f7584971-4b3c-4646-a4ff-4d466354156c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:49.869968 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f7584971-4b3c-4646-a4ff-4d466354156c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:49.877947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f7584971-4b3c-4646-a4ff-4d466354156c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:49.878460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f7584971-4b3c-4646-a4ff-4d466354156c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:49.879353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f7584971-4b3c-4646-a4ff-4d466354156c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:49.879852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f7584971-4b3c-4646-a4ff-4d466354156c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:50.095154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f7584971-4b3c-4646-a4ff-4d466354156c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:50.104334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f7584971-4b3c-4646-a4ff-4d466354156c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.244720 Dec 21 04:14:50.104932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 605/1169] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:49 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:50.221428 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a5acfaa7-6100-404d-9362-f904b71bfe5e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:50.222023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a5acfaa7-6100-404d-9362-f904b71bfe5e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:50.229807 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5acfaa7-6100-404d-9362-f904b71bfe5e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:50.230311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5acfaa7-6100-404d-9362-f904b71bfe5e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:50.231163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5acfaa7-6100-404d-9362-f904b71bfe5e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:50.231651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5acfaa7-6100-404d-9362-f904b71bfe5e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:50.361555 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a5acfaa7-6100-404d-9362-f904b71bfe5e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:50.377387 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a5acfaa7-6100-404d-9362-f904b71bfe5e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:50.383922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a5acfaa7-6100-404d-9362-f904b71bfe5e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:50.386098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a5acfaa7-6100-404d-9362-f904b71bfe5e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.174335 Dec 21 04:14:50.386684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 565/1170] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:50 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:51.127759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7edbcf8a-51a5-49e9-9e3f-c14e8672fdc2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:51.128434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7edbcf8a-51a5-49e9-9e3f-c14e8672fdc2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:51.136967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7edbcf8a-51a5-49e9-9e3f-c14e8672fdc2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:51.137479 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7edbcf8a-51a5-49e9-9e3f-c14e8672fdc2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:51.138317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7edbcf8a-51a5-49e9-9e3f-c14e8672fdc2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:51.138816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7edbcf8a-51a5-49e9-9e3f-c14e8672fdc2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:51.357737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7edbcf8a-51a5-49e9-9e3f-c14e8672fdc2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:51.366864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7edbcf8a-51a5-49e9-9e3f-c14e8672fdc2 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248761 Dec 21 04:14:51.367491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 606/1171] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:51 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:51.410795 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-65594662-572f-405c-9694-ee76f7f5c31e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:51.411426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-65594662-572f-405c-9694-ee76f7f5c31e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:51.419943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-65594662-572f-405c-9694-ee76f7f5c31e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:51.420447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-65594662-572f-405c-9694-ee76f7f5c31e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:51.421270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-65594662-572f-405c-9694-ee76f7f5c31e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:51.421758 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-65594662-572f-405c-9694-ee76f7f5c31e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:51.554633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-65594662-572f-405c-9694-ee76f7f5c31e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:51.569626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-65594662-572f-405c-9694-ee76f7f5c31e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:51.576908 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-65594662-572f-405c-9694-ee76f7f5c31e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:51.578080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-65594662-572f-405c-9694-ee76f7f5c31e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.176530 Dec 21 04:14:51.578668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 566/1172] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:51 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:52.390932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e8215543-b17e-410f-bd1c-5b6ea0a03b5a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:52.391611 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e8215543-b17e-410f-bd1c-5b6ea0a03b5a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:52.399438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e8215543-b17e-410f-bd1c-5b6ea0a03b5a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:52.400608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e8215543-b17e-410f-bd1c-5b6ea0a03b5a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:52.401584 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e8215543-b17e-410f-bd1c-5b6ea0a03b5a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:52.402079 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e8215543-b17e-410f-bd1c-5b6ea0a03b5a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:52.603430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cce04b6b-2537-4e0c-9fd0-a05a5f01672c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:52.604112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cce04b6b-2537-4e0c-9fd0-a05a5f01672c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:52.613457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cce04b6b-2537-4e0c-9fd0-a05a5f01672c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:52.614321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cce04b6b-2537-4e0c-9fd0-a05a5f01672c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:52.615210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cce04b6b-2537-4e0c-9fd0-a05a5f01672c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:52.615765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cce04b6b-2537-4e0c-9fd0-a05a5f01672c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:52.629152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e8215543-b17e-410f-bd1c-5b6ea0a03b5a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:52.639440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e8215543-b17e-410f-bd1c-5b6ea0a03b5a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.257909 Dec 21 04:14:52.640331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 607/1173] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:52 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:52.752995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cce04b6b-2537-4e0c-9fd0-a05a5f01672c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:52.768846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cce04b6b-2537-4e0c-9fd0-a05a5f01672c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:52.775382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cce04b6b-2537-4e0c-9fd0-a05a5f01672c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:52.776562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cce04b6b-2537-4e0c-9fd0-a05a5f01672c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.182739 Dec 21 04:14:52.777141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 567/1174] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:52 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:53.663111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dc1fce52-bb85-4fca-8364-5086f181fd06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:53.663707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dc1fce52-bb85-4fca-8364-5086f181fd06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:53.672136 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc1fce52-bb85-4fca-8364-5086f181fd06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:53.672644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc1fce52-bb85-4fca-8364-5086f181fd06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:53.673508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc1fce52-bb85-4fca-8364-5086f181fd06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:53.674044 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc1fce52-bb85-4fca-8364-5086f181fd06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:53.800801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-14699c69-998a-411b-8daf-453d8b34b20b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:53.801773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-14699c69-998a-411b-8daf-453d8b34b20b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:53.810222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-14699c69-998a-411b-8daf-453d8b34b20b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:53.810744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-14699c69-998a-411b-8daf-453d8b34b20b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:53.811632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-14699c69-998a-411b-8daf-453d8b34b20b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:53.812144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-14699c69-998a-411b-8daf-453d8b34b20b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:53.895490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dc1fce52-bb85-4fca-8364-5086f181fd06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:53.905295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dc1fce52-bb85-4fca-8364-5086f181fd06 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.251252 Dec 21 04:14:53.905889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 608/1175] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:53 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:53.944671 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-14699c69-998a-411b-8daf-453d8b34b20b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:53.960334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-14699c69-998a-411b-8daf-453d8b34b20b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:53.968818 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-14699c69-998a-411b-8daf-453d8b34b20b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:53.969997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-14699c69-998a-411b-8daf-453d8b34b20b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.178266 Dec 21 04:14:53.970585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 568/1176] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:53 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:14:54.928598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c2afc3a0-a1b2-443a-b050-a8c273371a94 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:54.929270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c2afc3a0-a1b2-443a-b050-a8c273371a94 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:54.937202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c2afc3a0-a1b2-443a-b050-a8c273371a94 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:54.937737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c2afc3a0-a1b2-443a-b050-a8c273371a94 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:54.938538 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c2afc3a0-a1b2-443a-b050-a8c273371a94 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:54.939059 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c2afc3a0-a1b2-443a-b050-a8c273371a94 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:54.995132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1597ec9d-468d-4c75-b080-7b1dc7ea0618 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:54.995804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1597ec9d-468d-4c75-b080-7b1dc7ea0618 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:55.003668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1597ec9d-468d-4c75-b080-7b1dc7ea0618 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:55.004181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1597ec9d-468d-4c75-b080-7b1dc7ea0618 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:55.005019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1597ec9d-468d-4c75-b080-7b1dc7ea0618 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:55.005517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1597ec9d-468d-4c75-b080-7b1dc7ea0618 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:55.141427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1597ec9d-468d-4c75-b080-7b1dc7ea0618 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:55.157279 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1597ec9d-468d-4c75-b080-7b1dc7ea0618 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:55.157458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c2afc3a0-a1b2-443a-b050-a8c273371a94 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:55.163784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1597ec9d-468d-4c75-b080-7b1dc7ea0618 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:55.164978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1597ec9d-468d-4c75-b080-7b1dc7ea0618 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.179518 Dec 21 04:14:55.165992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 569/1177] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:54 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:14:55.166433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c2afc3a0-a1b2-443a-b050-a8c273371a94 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247035 Dec 21 04:14:55.167024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 609/1178] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:54 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:56.190532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-68fa2a36-ea48-4ddf-82e0-2ebf695e3d04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:56.191101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-010590ca-0866-4e5e-8cce-c0592f566981 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:56.191229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-010590ca-0866-4e5e-8cce-c0592f566981 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:56.191354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-68fa2a36-ea48-4ddf-82e0-2ebf695e3d04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:56.199307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-010590ca-0866-4e5e-8cce-c0592f566981 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:56.199544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68fa2a36-ea48-4ddf-82e0-2ebf695e3d04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:56.199811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-010590ca-0866-4e5e-8cce-c0592f566981 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:56.200058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68fa2a36-ea48-4ddf-82e0-2ebf695e3d04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:56.200640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-010590ca-0866-4e5e-8cce-c0592f566981 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:56.200940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68fa2a36-ea48-4ddf-82e0-2ebf695e3d04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:56.201134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-010590ca-0866-4e5e-8cce-c0592f566981 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:56.201436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68fa2a36-ea48-4ddf-82e0-2ebf695e3d04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:56.335516 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-010590ca-0866-4e5e-8cce-c0592f566981 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:56.351323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-010590ca-0866-4e5e-8cce-c0592f566981 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:56.358570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-010590ca-0866-4e5e-8cce-c0592f566981 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:56.359776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-010590ca-0866-4e5e-8cce-c0592f566981 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.179231 Dec 21 04:14:56.360373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 610/1179] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:56 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:56.422297 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-68fa2a36-ea48-4ddf-82e0-2ebf695e3d04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:56.431490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-68fa2a36-ea48-4ddf-82e0-2ebf695e3d04 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.250576 Dec 21 04:14:56.432087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 570/1180] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:56 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:57.384845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8ba6442b-3dfb-447d-9a3e-578e9e266f03 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:57.385516 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8ba6442b-3dfb-447d-9a3e-578e9e266f03 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:57.393634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8ba6442b-3dfb-447d-9a3e-578e9e266f03 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:57.394140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8ba6442b-3dfb-447d-9a3e-578e9e266f03 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:57.395006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8ba6442b-3dfb-447d-9a3e-578e9e266f03 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:57.395511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8ba6442b-3dfb-447d-9a3e-578e9e266f03 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:57.455194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-318602da-08a6-4186-aa51-0e7ca2a2552f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:57.456214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-318602da-08a6-4186-aa51-0e7ca2a2552f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:57.464719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-318602da-08a6-4186-aa51-0e7ca2a2552f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:57.465229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-318602da-08a6-4186-aa51-0e7ca2a2552f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:57.466069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-318602da-08a6-4186-aa51-0e7ca2a2552f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:57.466564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-318602da-08a6-4186-aa51-0e7ca2a2552f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:57.529377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8ba6442b-3dfb-447d-9a3e-578e9e266f03 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:57.545152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8ba6442b-3dfb-447d-9a3e-578e9e266f03 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:57.551728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8ba6442b-3dfb-447d-9a3e-578e9e266f03 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:57.552903 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8ba6442b-3dfb-447d-9a3e-578e9e266f03 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.177793 Dec 21 04:14:57.553481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 611/1181] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:57 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:57.685456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-318602da-08a6-4186-aa51-0e7ca2a2552f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:57.694358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-318602da-08a6-4186-aa51-0e7ca2a2552f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248601 Dec 21 04:14:57.694974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 571/1182] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:57 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:58.578493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ba8d7972-c97d-42fb-95d6-f5dbe9c27510 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:58.579182 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ba8d7972-c97d-42fb-95d6-f5dbe9c27510 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:58.587781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ba8d7972-c97d-42fb-95d6-f5dbe9c27510 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:58.588283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ba8d7972-c97d-42fb-95d6-f5dbe9c27510 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:58.589108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ba8d7972-c97d-42fb-95d6-f5dbe9c27510 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:58.589592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ba8d7972-c97d-42fb-95d6-f5dbe9c27510 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:58.718113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2f422406-400a-4900-bcdb-c8620b690906 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:58.718574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ba8d7972-c97d-42fb-95d6-f5dbe9c27510 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:58.719000 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2f422406-400a-4900-bcdb-c8620b690906 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:58.726980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2f422406-400a-4900-bcdb-c8620b690906 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:58.727504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2f422406-400a-4900-bcdb-c8620b690906 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:58.728435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2f422406-400a-4900-bcdb-c8620b690906 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:58.728933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2f422406-400a-4900-bcdb-c8620b690906 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:58.733476 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ba8d7972-c97d-42fb-95d6-f5dbe9c27510 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:58.740016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ba8d7972-c97d-42fb-95d6-f5dbe9c27510 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:58.741439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ba8d7972-c97d-42fb-95d6-f5dbe9c27510 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.172701 Dec 21 04:14:58.742027 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 612/1183] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:58 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:58.946606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2f422406-400a-4900-bcdb-c8620b690906 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:58.955425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2f422406-400a-4900-bcdb-c8620b690906 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246570 Dec 21 04:14:58.956014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 572/1184] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:58 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:14:59.766331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-23ab6085-c1b8-4222-ab3b-e28068cc496a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:59.766936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-23ab6085-c1b8-4222-ab3b-e28068cc496a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:59.774802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23ab6085-c1b8-4222-ab3b-e28068cc496a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:59.775378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23ab6085-c1b8-4222-ab3b-e28068cc496a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:59.776201 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23ab6085-c1b8-4222-ab3b-e28068cc496a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:59.776689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-23ab6085-c1b8-4222-ab3b-e28068cc496a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:59.908972 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-23ab6085-c1b8-4222-ab3b-e28068cc496a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:59.924150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-23ab6085-c1b8-4222-ab3b-e28068cc496a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:59.931339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-23ab6085-c1b8-4222-ab3b-e28068cc496a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:14:59.932576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-23ab6085-c1b8-4222-ab3b-e28068cc496a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.175407 Dec 21 04:14:59.933150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 613/1185] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:14:59 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:14:59.979285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e235af7d-fcf2-4832-8c36-61bee8384fbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:14:59.979959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e235af7d-fcf2-4832-8c36-61bee8384fbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:14:59.987832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e235af7d-fcf2-4832-8c36-61bee8384fbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:59.988339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e235af7d-fcf2-4832-8c36-61bee8384fbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:14:59.989167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e235af7d-fcf2-4832-8c36-61bee8384fbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:14:59.989655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e235af7d-fcf2-4832-8c36-61bee8384fbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:00.206463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e235af7d-fcf2-4832-8c36-61bee8384fbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:00.216345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e235af7d-fcf2-4832-8c36-61bee8384fbf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246643 Dec 21 04:15:00.216941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 573/1186] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:14:59 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:00.957919 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ef3525f2-1e00-411a-9982-ab089226d83c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:00.958507 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ef3525f2-1e00-411a-9982-ab089226d83c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:00.966484 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef3525f2-1e00-411a-9982-ab089226d83c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:00.967034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef3525f2-1e00-411a-9982-ab089226d83c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:00.967857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef3525f2-1e00-411a-9982-ab089226d83c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:00.968346 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef3525f2-1e00-411a-9982-ab089226d83c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:01.099614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ef3525f2-1e00-411a-9982-ab089226d83c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:01.114370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ef3525f2-1e00-411a-9982-ab089226d83c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:01.121665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ef3525f2-1e00-411a-9982-ab089226d83c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:01.122833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ef3525f2-1e00-411a-9982-ab089226d83c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.174275 Dec 21 04:15:01.123438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 614/1187] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:00 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:01.239672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2bc7d288-d445-40d1-a4c2-b5fd33113816 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:01.240345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2bc7d288-d445-40d1-a4c2-b5fd33113816 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:01.249039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bc7d288-d445-40d1-a4c2-b5fd33113816 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:01.249574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bc7d288-d445-40d1-a4c2-b5fd33113816 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:01.250386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bc7d288-d445-40d1-a4c2-b5fd33113816 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:01.250875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bc7d288-d445-40d1-a4c2-b5fd33113816 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:01.482160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2bc7d288-d445-40d1-a4c2-b5fd33113816 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:01.491569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2bc7d288-d445-40d1-a4c2-b5fd33113816 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.260792 Dec 21 04:15:01.492106 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 574/1188] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:01 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:02.147071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f2ef50c8-8cc4-4da3-a386-f062d03e6c6e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:02.147734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f2ef50c8-8cc4-4da3-a386-f062d03e6c6e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:02.156508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2ef50c8-8cc4-4da3-a386-f062d03e6c6e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:02.157014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2ef50c8-8cc4-4da3-a386-f062d03e6c6e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:02.157845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2ef50c8-8cc4-4da3-a386-f062d03e6c6e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:02.158340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2ef50c8-8cc4-4da3-a386-f062d03e6c6e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:02.288203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f2ef50c8-8cc4-4da3-a386-f062d03e6c6e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:02.302978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f2ef50c8-8cc4-4da3-a386-f062d03e6c6e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:02.309958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f2ef50c8-8cc4-4da3-a386-f062d03e6c6e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:02.311162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f2ef50c8-8cc4-4da3-a386-f062d03e6c6e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.173311 Dec 21 04:15:02.311748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 615/1189] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:02 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:02.516619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cd72472c-1051-4470-9aae-573caf186c1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:02.517274 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cd72472c-1051-4470-9aae-573caf186c1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:02.525165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cd72472c-1051-4470-9aae-573caf186c1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:02.525664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cd72472c-1051-4470-9aae-573caf186c1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:02.526483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cd72472c-1051-4470-9aae-573caf186c1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:02.526994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cd72472c-1051-4470-9aae-573caf186c1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:02.744833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cd72472c-1051-4470-9aae-573caf186c1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:02.753639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cd72472c-1051-4470-9aae-573caf186c1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246827 Dec 21 04:15:02.754242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 575/1190] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:02 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:03.336341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-883eab51-c24d-499a-a305-edde8437096c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:03.337021 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-883eab51-c24d-499a-a305-edde8437096c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:03.345005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-883eab51-c24d-499a-a305-edde8437096c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:03.345522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-883eab51-c24d-499a-a305-edde8437096c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:03.346340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-883eab51-c24d-499a-a305-edde8437096c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:03.346832 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-883eab51-c24d-499a-a305-edde8437096c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:03.479690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-883eab51-c24d-499a-a305-edde8437096c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:03.495636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-883eab51-c24d-499a-a305-edde8437096c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:03.502110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-883eab51-c24d-499a-a305-edde8437096c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:03.503313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-883eab51-c24d-499a-a305-edde8437096c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.176154 Dec 21 04:15:03.503902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 616/1191] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:03 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:03.777494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dff39c1b-3c41-4eed-9e3f-81d1182e322e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:03.778158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dff39c1b-3c41-4eed-9e3f-81d1182e322e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:03.786015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dff39c1b-3c41-4eed-9e3f-81d1182e322e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:03.786527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dff39c1b-3c41-4eed-9e3f-81d1182e322e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:03.787387 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dff39c1b-3c41-4eed-9e3f-81d1182e322e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:03.787880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dff39c1b-3c41-4eed-9e3f-81d1182e322e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:04.004916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dff39c1b-3c41-4eed-9e3f-81d1182e322e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:04.013955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dff39c1b-3c41-4eed-9e3f-81d1182e322e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.246249 Dec 21 04:15:04.014548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 576/1192] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:03 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:04.528309 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1a1c1d7c-630f-4aeb-9560-8860c487a3ba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:04.528976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1a1c1d7c-630f-4aeb-9560-8860c487a3ba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:04.536890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a1c1d7c-630f-4aeb-9560-8860c487a3ba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:04.537450 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a1c1d7c-630f-4aeb-9560-8860c487a3ba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:04.538230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a1c1d7c-630f-4aeb-9560-8860c487a3ba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:04.538723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1a1c1d7c-630f-4aeb-9560-8860c487a3ba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:04.672115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1a1c1d7c-630f-4aeb-9560-8860c487a3ba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:04.688087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1a1c1d7c-630f-4aeb-9560-8860c487a3ba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:04.694597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1a1c1d7c-630f-4aeb-9560-8860c487a3ba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:04.695811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1a1c1d7c-630f-4aeb-9560-8860c487a3ba tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.177437 Dec 21 04:15:04.697169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 617/1193] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:04 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:05.037906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-55003a43-c5a1-4233-8228-125f8e5275d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:05.038579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-55003a43-c5a1-4233-8228-125f8e5275d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:05.047171 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55003a43-c5a1-4233-8228-125f8e5275d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:05.047679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55003a43-c5a1-4233-8228-125f8e5275d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:05.048513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55003a43-c5a1-4233-8228-125f8e5275d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:05.048984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55003a43-c5a1-4233-8228-125f8e5275d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:05.264978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-55003a43-c5a1-4233-8228-125f8e5275d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:05.273897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-55003a43-c5a1-4233-8228-125f8e5275d4 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245158 Dec 21 04:15:05.275019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 577/1194] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:05 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:05.721450 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-962d4b55-67ae-455a-a304-df86d12536e8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:05.722119 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-962d4b55-67ae-455a-a304-df86d12536e8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:05.730179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-962d4b55-67ae-455a-a304-df86d12536e8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:05.730686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-962d4b55-67ae-455a-a304-df86d12536e8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:05.731539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-962d4b55-67ae-455a-a304-df86d12536e8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:05.732032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-962d4b55-67ae-455a-a304-df86d12536e8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:05.861669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-962d4b55-67ae-455a-a304-df86d12536e8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:05.876667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-962d4b55-67ae-455a-a304-df86d12536e8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:05.883216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-962d4b55-67ae-455a-a304-df86d12536e8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:05.885005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-962d4b55-67ae-455a-a304-df86d12536e8 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.173358 Dec 21 04:15:05.885585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 618/1195] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:05 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:06.297671 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-be1b6cb1-55cf-406c-bda7-8b8e84ec8958 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:06.298329 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-be1b6cb1-55cf-406c-bda7-8b8e84ec8958 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:06.306686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be1b6cb1-55cf-406c-bda7-8b8e84ec8958 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:06.307207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be1b6cb1-55cf-406c-bda7-8b8e84ec8958 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:06.308033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be1b6cb1-55cf-406c-bda7-8b8e84ec8958 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:06.308521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be1b6cb1-55cf-406c-bda7-8b8e84ec8958 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:06.528359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-be1b6cb1-55cf-406c-bda7-8b8e84ec8958 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:06.537212 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-be1b6cb1-55cf-406c-bda7-8b8e84ec8958 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.248575 Dec 21 04:15:06.537797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 578/1196] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:06 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:06.909732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3bbd2c0c-30a3-469c-aae2-4c0d057202d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:06.910393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3bbd2c0c-30a3-469c-aae2-4c0d057202d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:06.918928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3bbd2c0c-30a3-469c-aae2-4c0d057202d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:06.919444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3bbd2c0c-30a3-469c-aae2-4c0d057202d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:06.920265 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3bbd2c0c-30a3-469c-aae2-4c0d057202d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:06.920750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3bbd2c0c-30a3-469c-aae2-4c0d057202d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:07.054166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3bbd2c0c-30a3-469c-aae2-4c0d057202d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:07.068934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3bbd2c0c-30a3-469c-aae2-4c0d057202d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:07.075742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3bbd2c0c-30a3-469c-aae2-4c0d057202d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:07.076908 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3bbd2c0c-30a3-469c-aae2-4c0d057202d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.176337 Dec 21 04:15:07.077491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 619/1197] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:06 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:07.561495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2e539f31-0a47-4c50-adad-67cd8e836866 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:07.562152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2e539f31-0a47-4c50-adad-67cd8e836866 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:07.570019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e539f31-0a47-4c50-adad-67cd8e836866 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:07.570519 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e539f31-0a47-4c50-adad-67cd8e836866 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:07.571928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e539f31-0a47-4c50-adad-67cd8e836866 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:07.572414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e539f31-0a47-4c50-adad-67cd8e836866 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:07.788831 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2e539f31-0a47-4c50-adad-67cd8e836866 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:07.797745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2e539f31-0a47-4c50-adad-67cd8e836866 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.245781 Dec 21 04:15:07.798334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 579/1198] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:07 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:08.102746 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ade5a92f-bfdc-4d76-8614-adfce68b1758 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:08.103589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ade5a92f-bfdc-4d76-8614-adfce68b1758 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:08.111474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ade5a92f-bfdc-4d76-8614-adfce68b1758 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:08.111980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ade5a92f-bfdc-4d76-8614-adfce68b1758 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:08.112805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ade5a92f-bfdc-4d76-8614-adfce68b1758 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:08.113295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ade5a92f-bfdc-4d76-8614-adfce68b1758 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:08.246177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ade5a92f-bfdc-4d76-8614-adfce68b1758 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:08.261952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ade5a92f-bfdc-4d76-8614-adfce68b1758 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:08.268421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ade5a92f-bfdc-4d76-8614-adfce68b1758 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:08.269620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ade5a92f-bfdc-4d76-8614-adfce68b1758 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.176832 Dec 21 04:15:08.270211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 620/1199] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:08 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:08.822766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ea7fd5ca-4eca-4087-a02f-67862043e457 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:08.823465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ea7fd5ca-4eca-4087-a02f-67862043e457 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:08.831401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea7fd5ca-4eca-4087-a02f-67862043e457 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:08.831914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea7fd5ca-4eca-4087-a02f-67862043e457 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:08.832762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea7fd5ca-4eca-4087-a02f-67862043e457 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:08.833264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea7fd5ca-4eca-4087-a02f-67862043e457 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:09.051447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ea7fd5ca-4eca-4087-a02f-67862043e457 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:09.060886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ea7fd5ca-4eca-4087-a02f-67862043e457 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1567 microversion: 2.1 time: 0.247924 Dec 21 04:15:09.061469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 580/1200] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:08 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:09.084701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b1649742-dac7-46a7-b64a-084fbf371370 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '.version_select at 0x7f2bb8668378>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:09.294708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-aab4c8e8-15d1-4423-92c3-dda82c42a8e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:09.295403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-aab4c8e8-15d1-4423-92c3-dda82c42a8e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:09.303299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aab4c8e8-15d1-4423-92c3-dda82c42a8e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:09.303820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aab4c8e8-15d1-4423-92c3-dda82c42a8e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:09.304664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aab4c8e8-15d1-4423-92c3-dda82c42a8e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:09.305164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aab4c8e8-15d1-4423-92c3-dda82c42a8e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:09.441045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-aab4c8e8-15d1-4423-92c3-dda82c42a8e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:09.456934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-aab4c8e8-15d1-4423-92c3-dda82c42a8e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:09.463958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-aab4c8e8-15d1-4423-92c3-dda82c42a8e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:09.465173 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-aab4c8e8-15d1-4423-92c3-dda82c42a8e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.180030 Dec 21 04:15:09.465986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 581/1201] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:09 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:15:09.558678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b1649742-dac7-46a7-b64a-084fbf371370 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:09.566755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1649742-dac7-46a7-b64a-084fbf371370 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:09.567301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1649742-dac7-46a7-b64a-084fbf371370 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:09.568168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1649742-dac7-46a7-b64a-084fbf371370 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:09.568669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1649742-dac7-46a7-b64a-084fbf371370 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:09.632150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1649742-dac7-46a7-b64a-084fbf371370 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Acquired lock "refresh_cache-56c04726-583d-4c58-82b1-5baccee7c4a7" {{(pid=94299) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 21 04:15:10.490178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d3f5ede5-6947-46a4-babf-f059ed4bcf85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:10.490745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d3f5ede5-6947-46a4-babf-f059ed4bcf85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:10.498795 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3f5ede5-6947-46a4-babf-f059ed4bcf85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:10.499332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3f5ede5-6947-46a4-babf-f059ed4bcf85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:10.500181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3f5ede5-6947-46a4-babf-f059ed4bcf85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:10.501085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3f5ede5-6947-46a4-babf-f059ed4bcf85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:10.632722 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d3f5ede5-6947-46a4-babf-f059ed4bcf85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:10.647841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d3f5ede5-6947-46a4-babf-f059ed4bcf85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:10.654963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d3f5ede5-6947-46a4-babf-f059ed4bcf85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:10.656143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d3f5ede5-6947-46a4-babf-f059ed4bcf85 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.175645 Dec 21 04:15:10.661540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 582/1202] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:10 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:15:11.472069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-b1649742-dac7-46a7-b64a-084fbf371370 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Building network info cache for instance {{(pid=94299) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 21 04:15:11.573361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-bb336463-cbdd-4233-b2fc-c278bba5bc92 req-ac3a1f53-6748-4e50-8c03-89fb7c3e811a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c04726-583d-4c58-82b1-5baccee7c4a7", "tag": "499c69ca-3c31-461f-a533-f5bccf8a38fe"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:15:11.580134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:11.580134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:15:11.589727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-bb336463-cbdd-4233-b2fc-c278bba5bc92 req-ac3a1f53-6748-4e50-8c03-89fb7c3e811a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:11.590225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-bb336463-cbdd-4233-b2fc-c278bba5bc92 req-ac3a1f53-6748-4e50-8c03-89fb7c3e811a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:11.608476 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-bb336463-cbdd-4233-b2fc-c278bba5bc92 req-ac3a1f53-6748-4e50-8c03-89fb7c3e811a service nova] Creating event network-changed:499c69ca-3c31-461f-a533-f5bccf8a38fe for instance 56c04726-583d-4c58-82b1-5baccee7c4a7 on hv-cinder-73306 Dec 21 04:15:11.613669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-bb336463-cbdd-4233-b2fc-c278bba5bc92 req-ac3a1f53-6748-4e50-8c03-89fb7c3e811a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137169 Dec 21 04:15:11.614274 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 583/1203] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:15:11 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:15:11.689325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a136cce8-26e2-479f-8ef5-8ec863d4dc88 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:11.690410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a136cce8-26e2-479f-8ef5-8ec863d4dc88 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:11.700834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a136cce8-26e2-479f-8ef5-8ec863d4dc88 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:11.701635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a136cce8-26e2-479f-8ef5-8ec863d4dc88 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:11.702675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a136cce8-26e2-479f-8ef5-8ec863d4dc88 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:11.703537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a136cce8-26e2-479f-8ef5-8ec863d4dc88 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:11.907217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a136cce8-26e2-479f-8ef5-8ec863d4dc88 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:11.922996 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a136cce8-26e2-479f-8ef5-8ec863d4dc88 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:11.929966 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a136cce8-26e2-479f-8ef5-8ec863d4dc88 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:11.931365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a136cce8-26e2-479f-8ef5-8ec863d4dc88 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.253901 Dec 21 04:15:11.932110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 584/1204] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:11 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:15:12.360704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-b1649742-dac7-46a7-b64a-084fbf371370 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Updating instance_info_cache with network_info: [{"id": "499c69ca-3c31-461f-a533-f5bccf8a38fe", "address": "fa:16:3e:4b:9e:6f", "network": {"id": "013b4941-7458-42a2-bded-2718d1174ace", "bridge": "br-int", "label": "tempest-TestShelveInstance-518431990-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b07ec805977d456b9447a634af514cde", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap499c69ca-3c", "ovs_interfaceid": "499c69ca-3c31-461f-a533-f5bccf8a38fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94299) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 21 04:15:12.375651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1649742-dac7-46a7-b64a-084fbf371370 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Releasing lock "refresh_cache-56c04726-583d-4c58-82b1-5baccee7c4a7" {{(pid=94299) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 21 04:15:12.376665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b1649742-dac7-46a7-b64a-084fbf371370 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/c463c947-9168-47f0-b2af-3f01fc3598e4" status: 202 len: 0 microversion: 2.1 time: 3.301045 Dec 21 04:15:12.377334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 621/1205] 10.222.0.16 () {58 vars in 1253 bytes} [Mon Dec 21 04:15:09 2020] DELETE /compute/v2.1/os-floating-ips/c463c947-9168-47f0-b2af-3f01fc3598e4 => generated 0 bytes in 3302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:15:12.392362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-aae76e0e-19a8-4fe4-922d-11c3b8892a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:12.392938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-aae76e0e-19a8-4fe4-922d-11c3b8892a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:12.401806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aae76e0e-19a8-4fe4-922d-11c3b8892a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:12.402309 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aae76e0e-19a8-4fe4-922d-11c3b8892a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:12.403187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aae76e0e-19a8-4fe4-922d-11c3b8892a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:12.403692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aae76e0e-19a8-4fe4-922d-11c3b8892a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:12.484623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-aae76e0e-19a8-4fe4-922d-11c3b8892a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Going to try to terminate instance {{(pid=94298) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:15:12.613649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-aae76e0e-19a8-4fe4-922d-11c3b8892a45 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "DELETE /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 204 len: 0 microversion: 2.1 time: 0.231208 Dec 21 04:15:12.614596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 585/1206] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:15:12 2020] DELETE /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:15:12.630172 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-58f7176e-6e98-4e3b-b1bd-2f3fd50efaed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:12.630862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-58f7176e-6e98-4e3b-b1bd-2f3fd50efaed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:12.639429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58f7176e-6e98-4e3b-b1bd-2f3fd50efaed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:12.639942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58f7176e-6e98-4e3b-b1bd-2f3fd50efaed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:12.640792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58f7176e-6e98-4e3b-b1bd-2f3fd50efaed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:12.641283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58f7176e-6e98-4e3b-b1bd-2f3fd50efaed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:12.881804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-58f7176e-6e98-4e3b-b1bd-2f3fd50efaed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:12.893961 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-58f7176e-6e98-4e3b-b1bd-2f3fd50efaed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1454 microversion: 2.1 time: 0.273575 Dec 21 04:15:12.894794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 622/1207] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:12 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1454 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:12.956125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f4432928-da7b-434d-aa6d-30683df41fa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:12.957183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f4432928-da7b-434d-aa6d-30683df41fa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:12.966051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4432928-da7b-434d-aa6d-30683df41fa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:12.966665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4432928-da7b-434d-aa6d-30683df41fa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:12.967633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4432928-da7b-434d-aa6d-30683df41fa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:12.968214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4432928-da7b-434d-aa6d-30683df41fa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:13.128506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f4432928-da7b-434d-aa6d-30683df41fa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:13.144020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f4432928-da7b-434d-aa6d-30683df41fa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:13.151318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f4432928-da7b-434d-aa6d-30683df41fa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:13.152533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f4432928-da7b-434d-aa6d-30683df41fa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.206397 Dec 21 04:15:13.153139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 586/1208] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:12 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:13.855811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-e5b54fb1-eb01-4eb8-93f4-87e18eea0905 req-9e53aaf2-f71b-4e88-86f8-fb810ef08edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c04726-583d-4c58-82b1-5baccee7c4a7", "name": "network-vif-deleted", "tag": "499c69ca-3c31-461f-a533-f5bccf8a38fe"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:15:13.866777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:13.866777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:15:13.883999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-e5b54fb1-eb01-4eb8-93f4-87e18eea0905 req-9e53aaf2-f71b-4e88-86f8-fb810ef08edd service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:13.884564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-e5b54fb1-eb01-4eb8-93f4-87e18eea0905 req-9e53aaf2-f71b-4e88-86f8-fb810ef08edd service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:13.905473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-e5b54fb1-eb01-4eb8-93f4-87e18eea0905 req-9e53aaf2-f71b-4e88-86f8-fb810ef08edd service nova] Creating event network-vif-deleted:499c69ca-3c31-461f-a533-f5bccf8a38fe for instance 56c04726-583d-4c58-82b1-5baccee7c4a7 on hv-cinder-73306 Dec 21 04:15:13.911058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-e5b54fb1-eb01-4eb8-93f4-87e18eea0905 req-9e53aaf2-f71b-4e88-86f8-fb810ef08edd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065495 Dec 21 04:15:13.912028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 623/1209] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:15:13 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:15:13.922830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-05bd3205-c5df-4d42-8a23-23d8836b346c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:13.923467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-05bd3205-c5df-4d42-8a23-23d8836b346c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:13.932573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-05bd3205-c5df-4d42-8a23-23d8836b346c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:13.933080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-05bd3205-c5df-4d42-8a23-23d8836b346c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:13.933938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-05bd3205-c5df-4d42-8a23-23d8836b346c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:13.935608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-05bd3205-c5df-4d42-8a23-23d8836b346c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:14.113711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-05bd3205-c5df-4d42-8a23-23d8836b346c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:14.123787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-05bd3205-c5df-4d42-8a23-23d8836b346c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.214320 Dec 21 04:15:14.124392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 587/1210] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:13 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:14.178014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-78494ad4-564d-49db-8b34-3ccc75d3b882 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:14.178703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-78494ad4-564d-49db-8b34-3ccc75d3b882 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:14.187434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-78494ad4-564d-49db-8b34-3ccc75d3b882 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:14.187941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-78494ad4-564d-49db-8b34-3ccc75d3b882 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:14.188762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-78494ad4-564d-49db-8b34-3ccc75d3b882 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:14.189294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-78494ad4-564d-49db-8b34-3ccc75d3b882 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:14.349739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-78494ad4-564d-49db-8b34-3ccc75d3b882 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:14.365628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-78494ad4-564d-49db-8b34-3ccc75d3b882 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:14.372455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-78494ad4-564d-49db-8b34-3ccc75d3b882 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:14.373625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-78494ad4-564d-49db-8b34-3ccc75d3b882 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.205425 Dec 21 04:15:14.374214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 624/1211] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:14 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:15.151778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a06a9f95-cb7b-42b8-bb1b-0f9af0e07516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:15.152436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a06a9f95-cb7b-42b8-bb1b-0f9af0e07516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:15.160363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a06a9f95-cb7b-42b8-bb1b-0f9af0e07516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:15.160870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a06a9f95-cb7b-42b8-bb1b-0f9af0e07516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:15.161699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a06a9f95-cb7b-42b8-bb1b-0f9af0e07516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:15.162189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a06a9f95-cb7b-42b8-bb1b-0f9af0e07516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:15.294873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a06a9f95-cb7b-42b8-bb1b-0f9af0e07516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:15.303797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a06a9f95-cb7b-42b8-bb1b-0f9af0e07516 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.161266 Dec 21 04:15:15.304385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 588/1212] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:15 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:15.397785 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3ae83732-073d-4f5f-a2ff-b6292f613390 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:15.398445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3ae83732-073d-4f5f-a2ff-b6292f613390 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:15.406421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ae83732-073d-4f5f-a2ff-b6292f613390 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:15.406876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ae83732-073d-4f5f-a2ff-b6292f613390 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:15.407752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ae83732-073d-4f5f-a2ff-b6292f613390 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:15.408244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3ae83732-073d-4f5f-a2ff-b6292f613390 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:15.539205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3ae83732-073d-4f5f-a2ff-b6292f613390 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:15.554698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3ae83732-073d-4f5f-a2ff-b6292f613390 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:15.562104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3ae83732-073d-4f5f-a2ff-b6292f613390 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:15.563301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3ae83732-073d-4f5f-a2ff-b6292f613390 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.174685 Dec 21 04:15:15.563886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 625/1213] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:15 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:16.328175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f040ba92-47ca-4d9d-9542-e35b43961a91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:16.328778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f040ba92-47ca-4d9d-9542-e35b43961a91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:16.337373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f040ba92-47ca-4d9d-9542-e35b43961a91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:16.337881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f040ba92-47ca-4d9d-9542-e35b43961a91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:16.338713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f040ba92-47ca-4d9d-9542-e35b43961a91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:16.339233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f040ba92-47ca-4d9d-9542-e35b43961a91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:16.468833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f040ba92-47ca-4d9d-9542-e35b43961a91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:16.478216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f040ba92-47ca-4d9d-9542-e35b43961a91 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.159885 Dec 21 04:15:16.478823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 589/1214] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:16 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:16.587235 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-271e84f8-1c60-4f1b-813a-4dc17f25221b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:16.587827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-271e84f8-1c60-4f1b-813a-4dc17f25221b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:16.595679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-271e84f8-1c60-4f1b-813a-4dc17f25221b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:16.596179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-271e84f8-1c60-4f1b-813a-4dc17f25221b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:16.596998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-271e84f8-1c60-4f1b-813a-4dc17f25221b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:16.597480 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-271e84f8-1c60-4f1b-813a-4dc17f25221b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:16.734949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-271e84f8-1c60-4f1b-813a-4dc17f25221b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:16.750418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-271e84f8-1c60-4f1b-813a-4dc17f25221b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:16.757959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-271e84f8-1c60-4f1b-813a-4dc17f25221b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:16.759770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-271e84f8-1c60-4f1b-813a-4dc17f25221b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.181793 Dec 21 04:15:16.760360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 626/1215] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:16 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:17.502610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4f97956c-7ad7-4735-a920-6f62dbc605f5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:17.503277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4f97956c-7ad7-4735-a920-6f62dbc605f5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:17.511654 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f97956c-7ad7-4735-a920-6f62dbc605f5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:17.512213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f97956c-7ad7-4735-a920-6f62dbc605f5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:17.513291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f97956c-7ad7-4735-a920-6f62dbc605f5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:17.513789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f97956c-7ad7-4735-a920-6f62dbc605f5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:17.645151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4f97956c-7ad7-4735-a920-6f62dbc605f5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:17.654782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4f97956c-7ad7-4735-a920-6f62dbc605f5 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.161584 Dec 21 04:15:17.655407 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 590/1216] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:17 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:17.784461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9ebd96cf-0353-4f56-9a46-e368c79807d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:17.785066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9ebd96cf-0353-4f56-9a46-e368c79807d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:17.793041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9ebd96cf-0353-4f56-9a46-e368c79807d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:17.793554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9ebd96cf-0353-4f56-9a46-e368c79807d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:17.794390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9ebd96cf-0353-4f56-9a46-e368c79807d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:17.794889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9ebd96cf-0353-4f56-9a46-e368c79807d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:17.926890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9ebd96cf-0353-4f56-9a46-e368c79807d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:17.942121 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9ebd96cf-0353-4f56-9a46-e368c79807d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:17.949286 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9ebd96cf-0353-4f56-9a46-e368c79807d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:17.950460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9ebd96cf-0353-4f56-9a46-e368c79807d3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.175297 Dec 21 04:15:17.951073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 627/1217] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:17 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:18.678684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7e0a271c-6c08-4da5-aa63-1d08da20f83e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:18.679371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7e0a271c-6c08-4da5-aa63-1d08da20f83e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:18.692913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e0a271c-6c08-4da5-aa63-1d08da20f83e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:18.693436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e0a271c-6c08-4da5-aa63-1d08da20f83e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:18.694279 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e0a271c-6c08-4da5-aa63-1d08da20f83e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:18.694773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e0a271c-6c08-4da5-aa63-1d08da20f83e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:18.827478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7e0a271c-6c08-4da5-aa63-1d08da20f83e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:18.836749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7e0a271c-6c08-4da5-aa63-1d08da20f83e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.166639 Dec 21 04:15:18.837443 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 591/1218] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:18 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:18.974741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2a62eea6-e505-4494-950e-40dc3cfb9e65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:18.975427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2a62eea6-e505-4494-950e-40dc3cfb9e65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:18.983843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2a62eea6-e505-4494-950e-40dc3cfb9e65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:18.984349 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2a62eea6-e505-4494-950e-40dc3cfb9e65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:18.985168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2a62eea6-e505-4494-950e-40dc3cfb9e65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:18.985657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2a62eea6-e505-4494-950e-40dc3cfb9e65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:19.113458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2a62eea6-e505-4494-950e-40dc3cfb9e65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:19.128475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2a62eea6-e505-4494-950e-40dc3cfb9e65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:19.134954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2a62eea6-e505-4494-950e-40dc3cfb9e65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:19.136115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2a62eea6-e505-4494-950e-40dc3cfb9e65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.170671 Dec 21 04:15:19.136697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 628/1219] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:18 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:19.859833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e04ebeba-255c-4a1f-9427-6492a8767a1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:19.860433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e04ebeba-255c-4a1f-9427-6492a8767a1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:19.869381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e04ebeba-255c-4a1f-9427-6492a8767a1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:19.869893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e04ebeba-255c-4a1f-9427-6492a8767a1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:19.870753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e04ebeba-255c-4a1f-9427-6492a8767a1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:19.871243 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e04ebeba-255c-4a1f-9427-6492a8767a1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:20.000186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e04ebeba-255c-4a1f-9427-6492a8767a1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:20.009125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e04ebeba-255c-4a1f-9427-6492a8767a1a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.158328 Dec 21 04:15:20.009721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 592/1220] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:19 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:20.160264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ea60ccba-0971-4d48-a771-15b37cc82ecd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:20.160857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ea60ccba-0971-4d48-a771-15b37cc82ecd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:20.169336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea60ccba-0971-4d48-a771-15b37cc82ecd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:20.169837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea60ccba-0971-4d48-a771-15b37cc82ecd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:20.170660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea60ccba-0971-4d48-a771-15b37cc82ecd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:20.171175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea60ccba-0971-4d48-a771-15b37cc82ecd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:20.303033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ea60ccba-0971-4d48-a771-15b37cc82ecd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:20.317897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ea60ccba-0971-4d48-a771-15b37cc82ecd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:20.324681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ea60ccba-0971-4d48-a771-15b37cc82ecd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:20.325839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ea60ccba-0971-4d48-a771-15b37cc82ecd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.174867 Dec 21 04:15:20.326420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 629/1221] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:20 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:21.032478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4476db7d-7362-488a-b0b3-23d683dcc53a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:21.033142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4476db7d-7362-488a-b0b3-23d683dcc53a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:21.041074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4476db7d-7362-488a-b0b3-23d683dcc53a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:21.041581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4476db7d-7362-488a-b0b3-23d683dcc53a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:21.042401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4476db7d-7362-488a-b0b3-23d683dcc53a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:21.042892 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4476db7d-7362-488a-b0b3-23d683dcc53a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:21.174670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4476db7d-7362-488a-b0b3-23d683dcc53a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:21.184032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4476db7d-7362-488a-b0b3-23d683dcc53a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.161175 Dec 21 04:15:21.184622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 593/1222] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:21 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:21.350538 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4b0890ee-19f1-4820-982e-1f993c52984c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:21.351164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4b0890ee-19f1-4820-982e-1f993c52984c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:21.359052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b0890ee-19f1-4820-982e-1f993c52984c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:21.359564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b0890ee-19f1-4820-982e-1f993c52984c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:21.360395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b0890ee-19f1-4820-982e-1f993c52984c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:21.360888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b0890ee-19f1-4820-982e-1f993c52984c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:21.494605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4b0890ee-19f1-4820-982e-1f993c52984c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:21.509598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4b0890ee-19f1-4820-982e-1f993c52984c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:21.516139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4b0890ee-19f1-4820-982e-1f993c52984c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:21.517308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4b0890ee-19f1-4820-982e-1f993c52984c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.175952 Dec 21 04:15:21.517898 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 630/1223] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:21 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:22.208140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-155cec5c-bf96-4075-912e-2638e5b2e92e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:22.208811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-155cec5c-bf96-4075-912e-2638e5b2e92e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:22.217636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-155cec5c-bf96-4075-912e-2638e5b2e92e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:22.218148 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-155cec5c-bf96-4075-912e-2638e5b2e92e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:22.219005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-155cec5c-bf96-4075-912e-2638e5b2e92e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:22.219506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-155cec5c-bf96-4075-912e-2638e5b2e92e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:22.353022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-155cec5c-bf96-4075-912e-2638e5b2e92e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:22.362093 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-155cec5c-bf96-4075-912e-2638e5b2e92e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.163202 Dec 21 04:15:22.362698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 594/1224] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:22 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:22.541732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b04be649-ba14-404c-a05d-3792143c4c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:22.542409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b04be649-ba14-404c-a05d-3792143c4c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:22.550321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b04be649-ba14-404c-a05d-3792143c4c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:22.550827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b04be649-ba14-404c-a05d-3792143c4c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:22.551683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b04be649-ba14-404c-a05d-3792143c4c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:22.552177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b04be649-ba14-404c-a05d-3792143c4c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:22.682772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b04be649-ba14-404c-a05d-3792143c4c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:22.698279 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b04be649-ba14-404c-a05d-3792143c4c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:22.709648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b04be649-ba14-404c-a05d-3792143c4c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:22.710841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b04be649-ba14-404c-a05d-3792143c4c7c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.178483 Dec 21 04:15:22.711498 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 631/1225] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:22 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:23.385285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a27d5c9b-55f5-4c1e-9a0a-afc9adb4050a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:23.385952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a27d5c9b-55f5-4c1e-9a0a-afc9adb4050a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:23.393861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a27d5c9b-55f5-4c1e-9a0a-afc9adb4050a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:23.394375 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a27d5c9b-55f5-4c1e-9a0a-afc9adb4050a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:23.395237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a27d5c9b-55f5-4c1e-9a0a-afc9adb4050a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:23.395734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a27d5c9b-55f5-4c1e-9a0a-afc9adb4050a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:23.531789 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a27d5c9b-55f5-4c1e-9a0a-afc9adb4050a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:23.541518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a27d5c9b-55f5-4c1e-9a0a-afc9adb4050a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.165282 Dec 21 04:15:23.542116 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 595/1226] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:23 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:23.735168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-11cb7497-572a-47a4-b9c7-39395e1319f6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:23.735775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-11cb7497-572a-47a4-b9c7-39395e1319f6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:23.744375 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11cb7497-572a-47a4-b9c7-39395e1319f6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:23.744915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11cb7497-572a-47a4-b9c7-39395e1319f6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:23.745744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11cb7497-572a-47a4-b9c7-39395e1319f6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:23.746231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11cb7497-572a-47a4-b9c7-39395e1319f6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:23.878756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-11cb7497-572a-47a4-b9c7-39395e1319f6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:23.894008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-11cb7497-572a-47a4-b9c7-39395e1319f6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:23.901294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-11cb7497-572a-47a4-b9c7-39395e1319f6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:23.902456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-11cb7497-572a-47a4-b9c7-39395e1319f6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.176679 Dec 21 04:15:23.903053 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 632/1227] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:23 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:24.565380 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cdb3f995-c96b-4fb2-8e9c-7301b3cca24c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:24.566051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cdb3f995-c96b-4fb2-8e9c-7301b3cca24c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:24.574149 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cdb3f995-c96b-4fb2-8e9c-7301b3cca24c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:24.574660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cdb3f995-c96b-4fb2-8e9c-7301b3cca24c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:24.575518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cdb3f995-c96b-4fb2-8e9c-7301b3cca24c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:24.576014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cdb3f995-c96b-4fb2-8e9c-7301b3cca24c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:24.712996 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-cdb3f995-c96b-4fb2-8e9c-7301b3cca24c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:24.722054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cdb3f995-c96b-4fb2-8e9c-7301b3cca24c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.165695 Dec 21 04:15:24.722774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 596/1228] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:24 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:24.926989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-31914360-bea1-4fef-9230-228865fa15c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:24.927673 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-31914360-bea1-4fef-9230-228865fa15c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:24.935774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31914360-bea1-4fef-9230-228865fa15c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:24.936293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31914360-bea1-4fef-9230-228865fa15c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:24.937146 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31914360-bea1-4fef-9230-228865fa15c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:24.937648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31914360-bea1-4fef-9230-228865fa15c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:25.073425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-31914360-bea1-4fef-9230-228865fa15c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:25.088839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-31914360-bea1-4fef-9230-228865fa15c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:25.095549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-31914360-bea1-4fef-9230-228865fa15c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:25.096775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-31914360-bea1-4fef-9230-228865fa15c4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.179141 Dec 21 04:15:25.097361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 633/1229] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:24 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:25.746772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8fb9b00d-93d4-4ca6-a99e-e8472ee3c2c0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:25.747394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8fb9b00d-93d4-4ca6-a99e-e8472ee3c2c0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:25.755311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8fb9b00d-93d4-4ca6-a99e-e8472ee3c2c0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:25.755816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8fb9b00d-93d4-4ca6-a99e-e8472ee3c2c0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:25.756630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8fb9b00d-93d4-4ca6-a99e-e8472ee3c2c0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:25.757115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8fb9b00d-93d4-4ca6-a99e-e8472ee3c2c0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:25.891940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8fb9b00d-93d4-4ca6-a99e-e8472ee3c2c0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:25.901284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8fb9b00d-93d4-4ca6-a99e-e8472ee3c2c0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.164575 Dec 21 04:15:25.902134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 597/1230] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:25 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:26.122799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dec796da-6841-4fbb-bce9-36b5e8c3c0dc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:26.123499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dec796da-6841-4fbb-bce9-36b5e8c3c0dc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:26.131404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dec796da-6841-4fbb-bce9-36b5e8c3c0dc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:26.131917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dec796da-6841-4fbb-bce9-36b5e8c3c0dc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:26.132766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dec796da-6841-4fbb-bce9-36b5e8c3c0dc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:26.133262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dec796da-6841-4fbb-bce9-36b5e8c3c0dc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:26.262744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dec796da-6841-4fbb-bce9-36b5e8c3c0dc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:26.278300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dec796da-6841-4fbb-bce9-36b5e8c3c0dc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:26.284835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dec796da-6841-4fbb-bce9-36b5e8c3c0dc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:26.286002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dec796da-6841-4fbb-bce9-36b5e8c3c0dc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.173460 Dec 21 04:15:26.286592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 634/1231] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:26 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:26.924386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d11808a0-98a4-4dce-b9fc-95c43c76112c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:26.925060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d11808a0-98a4-4dce-b9fc-95c43c76112c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:26.933117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d11808a0-98a4-4dce-b9fc-95c43c76112c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:26.933634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d11808a0-98a4-4dce-b9fc-95c43c76112c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:26.934472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d11808a0-98a4-4dce-b9fc-95c43c76112c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:26.934994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d11808a0-98a4-4dce-b9fc-95c43c76112c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:27.065771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d11808a0-98a4-4dce-b9fc-95c43c76112c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:27.075399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d11808a0-98a4-4dce-b9fc-95c43c76112c tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.160303 Dec 21 04:15:27.075999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 598/1232] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:26 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:27.217268 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:15:27.217424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:15:27 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:15:27.311825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c22d5018-7ac3-4f67-8ae1-df5b285de43e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:27.312495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c22d5018-7ac3-4f67-8ae1-df5b285de43e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:27.321134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c22d5018-7ac3-4f67-8ae1-df5b285de43e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:27.321839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c22d5018-7ac3-4f67-8ae1-df5b285de43e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:27.322680 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c22d5018-7ac3-4f67-8ae1-df5b285de43e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:27.323207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c22d5018-7ac3-4f67-8ae1-df5b285de43e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:27.457391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c22d5018-7ac3-4f67-8ae1-df5b285de43e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:27.472936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c22d5018-7ac3-4f67-8ae1-df5b285de43e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:27.480069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c22d5018-7ac3-4f67-8ae1-df5b285de43e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:27.481249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c22d5018-7ac3-4f67-8ae1-df5b285de43e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.179477 Dec 21 04:15:27.481840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 635/1233] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:27 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:28.099223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1b176242-7ec7-43b1-a355-dd520e6298e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:28.099941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1b176242-7ec7-43b1-a355-dd520e6298e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:28.108107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b176242-7ec7-43b1-a355-dd520e6298e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:28.108647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b176242-7ec7-43b1-a355-dd520e6298e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:28.109468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b176242-7ec7-43b1-a355-dd520e6298e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:28.109961 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b176242-7ec7-43b1-a355-dd520e6298e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:28.244130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1b176242-7ec7-43b1-a355-dd520e6298e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:28.253253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1b176242-7ec7-43b1-a355-dd520e6298e3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.163694 Dec 21 04:15:28.253838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 599/1234] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:28 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:28.505764 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7764ad74-f60f-4dca-b7ad-4af20c4f097a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:28.506429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7764ad74-f60f-4dca-b7ad-4af20c4f097a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:28.514469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7764ad74-f60f-4dca-b7ad-4af20c4f097a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:28.515116 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7764ad74-f60f-4dca-b7ad-4af20c4f097a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:28.515947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7764ad74-f60f-4dca-b7ad-4af20c4f097a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:28.516436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7764ad74-f60f-4dca-b7ad-4af20c4f097a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:28.647780 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7764ad74-f60f-4dca-b7ad-4af20c4f097a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:28.662523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7764ad74-f60f-4dca-b7ad-4af20c4f097a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:28.669104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7764ad74-f60f-4dca-b7ad-4af20c4f097a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:28.670262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7764ad74-f60f-4dca-b7ad-4af20c4f097a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.173795 Dec 21 04:15:28.670839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 636/1235] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:28 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:29.276743 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-01c9f821-3a6b-4c95-afcd-ef063b5e06bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:29.277411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-01c9f821-3a6b-4c95-afcd-ef063b5e06bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:29.285323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-01c9f821-3a6b-4c95-afcd-ef063b5e06bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:29.285845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-01c9f821-3a6b-4c95-afcd-ef063b5e06bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:29.286808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-01c9f821-3a6b-4c95-afcd-ef063b5e06bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:29.287342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-01c9f821-3a6b-4c95-afcd-ef063b5e06bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:29.420915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-01c9f821-3a6b-4c95-afcd-ef063b5e06bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:29.429800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-01c9f821-3a6b-4c95-afcd-ef063b5e06bf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.162782 Dec 21 04:15:29.430393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 600/1236] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:29 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:29.695834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8d9ee406-4094-4cd8-bf34-9039f3e921e2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:29.696499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8d9ee406-4094-4cd8-bf34-9039f3e921e2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:29.704352 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d9ee406-4094-4cd8-bf34-9039f3e921e2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:29.704852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d9ee406-4094-4cd8-bf34-9039f3e921e2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:29.705670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d9ee406-4094-4cd8-bf34-9039f3e921e2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:29.706159 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8d9ee406-4094-4cd8-bf34-9039f3e921e2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:29.834326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8d9ee406-4094-4cd8-bf34-9039f3e921e2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:29.849845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8d9ee406-4094-4cd8-bf34-9039f3e921e2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:29.856531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8d9ee406-4094-4cd8-bf34-9039f3e921e2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:29.857689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8d9ee406-4094-4cd8-bf34-9039f3e921e2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.171845 Dec 21 04:15:29.858268 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 637/1237] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:29 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:30.452950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7007ada2-7cba-4283-a554-9bf16c16ef59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:30.453623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7007ada2-7cba-4283-a554-9bf16c16ef59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:30.461845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7007ada2-7cba-4283-a554-9bf16c16ef59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:30.462355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7007ada2-7cba-4283-a554-9bf16c16ef59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:30.463218 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7007ada2-7cba-4283-a554-9bf16c16ef59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:30.463711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7007ada2-7cba-4283-a554-9bf16c16ef59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:30.594168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7007ada2-7cba-4283-a554-9bf16c16ef59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:30.603550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7007ada2-7cba-4283-a554-9bf16c16ef59 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.159708 Dec 21 04:15:30.604135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 601/1238] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:30 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:30.882529 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-025d2a4b-2b30-4b75-8bed-0907d05bfa3f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:30.883224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-025d2a4b-2b30-4b75-8bed-0907d05bfa3f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:30.891090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-025d2a4b-2b30-4b75-8bed-0907d05bfa3f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:30.891598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-025d2a4b-2b30-4b75-8bed-0907d05bfa3f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:30.892453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-025d2a4b-2b30-4b75-8bed-0907d05bfa3f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:30.892926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-025d2a4b-2b30-4b75-8bed-0907d05bfa3f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:31.160694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-025d2a4b-2b30-4b75-8bed-0907d05bfa3f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:31.176361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-025d2a4b-2b30-4b75-8bed-0907d05bfa3f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:31.183095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-025d2a4b-2b30-4b75-8bed-0907d05bfa3f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:31.184265 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-025d2a4b-2b30-4b75-8bed-0907d05bfa3f tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.311040 Dec 21 04:15:31.184845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 638/1239] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:30 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:31.628023 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a9d0f06f-79c6-41c0-b4ea-0e71d2cf313b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:31.628685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a9d0f06f-79c6-41c0-b4ea-0e71d2cf313b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:31.637468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a9d0f06f-79c6-41c0-b4ea-0e71d2cf313b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:31.637974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a9d0f06f-79c6-41c0-b4ea-0e71d2cf313b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:31.638792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a9d0f06f-79c6-41c0-b4ea-0e71d2cf313b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:31.639332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a9d0f06f-79c6-41c0-b4ea-0e71d2cf313b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:31.770385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a9d0f06f-79c6-41c0-b4ea-0e71d2cf313b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:31.779622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a9d0f06f-79c6-41c0-b4ea-0e71d2cf313b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.160691 Dec 21 04:15:31.780222 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 602/1240] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:31 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:32.209345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2ad34f13-8175-43f4-a70e-63e725a60956 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:32.210016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2ad34f13-8175-43f4-a70e-63e725a60956 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:32.218304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ad34f13-8175-43f4-a70e-63e725a60956 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:32.218816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ad34f13-8175-43f4-a70e-63e725a60956 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:32.219670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ad34f13-8175-43f4-a70e-63e725a60956 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:32.220168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ad34f13-8175-43f4-a70e-63e725a60956 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:32.355022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2ad34f13-8175-43f4-a70e-63e725a60956 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:32.370658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2ad34f13-8175-43f4-a70e-63e725a60956 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:32.377234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2ad34f13-8175-43f4-a70e-63e725a60956 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:32.378417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2ad34f13-8175-43f4-a70e-63e725a60956 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.178227 Dec 21 04:15:32.379015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 639/1241] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:32 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:32.803184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f7aa4486-b591-43f0-be83-668b0008b0ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:32.803864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f7aa4486-b591-43f0-be83-668b0008b0ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:32.811752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f7aa4486-b591-43f0-be83-668b0008b0ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:32.812265 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f7aa4486-b591-43f0-be83-668b0008b0ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:32.813101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f7aa4486-b591-43f0-be83-668b0008b0ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:32.813609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f7aa4486-b591-43f0-be83-668b0008b0ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:32.946338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f7aa4486-b591-43f0-be83-668b0008b0ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:32.955262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f7aa4486-b591-43f0-be83-668b0008b0ed tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.161205 Dec 21 04:15:32.955861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 603/1242] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:32 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:33.403257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dd8baf47-8072-401b-ae05-2fc61dacfdaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:33.403922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dd8baf47-8072-401b-ae05-2fc61dacfdaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:33.411799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dd8baf47-8072-401b-ae05-2fc61dacfdaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:33.412298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dd8baf47-8072-401b-ae05-2fc61dacfdaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:33.413117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dd8baf47-8072-401b-ae05-2fc61dacfdaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:33.413601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dd8baf47-8072-401b-ae05-2fc61dacfdaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:33.544319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dd8baf47-8072-401b-ae05-2fc61dacfdaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:33.559760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dd8baf47-8072-401b-ae05-2fc61dacfdaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:33.566229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dd8baf47-8072-401b-ae05-2fc61dacfdaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:33.567429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dd8baf47-8072-401b-ae05-2fc61dacfdaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.173663 Dec 21 04:15:33.568009 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 640/1243] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:33 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:33.979845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f798254e-7cd2-4ec6-950d-5d49137857f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:33.980510 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f798254e-7cd2-4ec6-950d-5d49137857f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:33.988428 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f798254e-7cd2-4ec6-950d-5d49137857f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:33.988940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f798254e-7cd2-4ec6-950d-5d49137857f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:33.989776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f798254e-7cd2-4ec6-950d-5d49137857f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:33.990270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f798254e-7cd2-4ec6-950d-5d49137857f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:34.121131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f798254e-7cd2-4ec6-950d-5d49137857f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:34.129948 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f798254e-7cd2-4ec6-950d-5d49137857f1 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.160129 Dec 21 04:15:34.130534 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 604/1244] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:33 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:34.591411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1b9af857-137b-477f-9fe0-93ea3e3fd982 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:34.592092 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1b9af857-137b-477f-9fe0-93ea3e3fd982 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:34.600004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b9af857-137b-477f-9fe0-93ea3e3fd982 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:34.600510 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b9af857-137b-477f-9fe0-93ea3e3fd982 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:34.601398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b9af857-137b-477f-9fe0-93ea3e3fd982 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:34.601922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b9af857-137b-477f-9fe0-93ea3e3fd982 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:34.733801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1b9af857-137b-477f-9fe0-93ea3e3fd982 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:34.749828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1b9af857-137b-477f-9fe0-93ea3e3fd982 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:34.756380 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1b9af857-137b-477f-9fe0-93ea3e3fd982 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:34.758209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1b9af857-137b-477f-9fe0-93ea3e3fd982 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.175292 Dec 21 04:15:34.758792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 641/1245] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:34 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:35.153150 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6184cd57-69b6-49e0-9278-fbbd9edf1ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:35.153820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6184cd57-69b6-49e0-9278-fbbd9edf1ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:35.161702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6184cd57-69b6-49e0-9278-fbbd9edf1ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:35.162210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6184cd57-69b6-49e0-9278-fbbd9edf1ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:35.163067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6184cd57-69b6-49e0-9278-fbbd9edf1ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:35.163563 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6184cd57-69b6-49e0-9278-fbbd9edf1ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:35.296803 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6184cd57-69b6-49e0-9278-fbbd9edf1ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:35.305782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6184cd57-69b6-49e0-9278-fbbd9edf1ff8 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.161636 Dec 21 04:15:35.306384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 605/1246] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:35 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:35.783546 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-58a9f211-eed9-4ac9-939d-62abdf905b5c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:35.784161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-58a9f211-eed9-4ac9-939d-62abdf905b5c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:35.792528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58a9f211-eed9-4ac9-939d-62abdf905b5c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:35.793046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58a9f211-eed9-4ac9-939d-62abdf905b5c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:35.793890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58a9f211-eed9-4ac9-939d-62abdf905b5c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:35.794388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58a9f211-eed9-4ac9-939d-62abdf905b5c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:35.927275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-58a9f211-eed9-4ac9-939d-62abdf905b5c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:35.942080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-58a9f211-eed9-4ac9-939d-62abdf905b5c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:35.949376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-58a9f211-eed9-4ac9-939d-62abdf905b5c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:35.950550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-58a9f211-eed9-4ac9-939d-62abdf905b5c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.177256 Dec 21 04:15:35.951156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 642/1247] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:35 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:36.329258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-acae4b1c-682c-4ffd-bf74-1899daed7682 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:36.329929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-acae4b1c-682c-4ffd-bf74-1899daed7682 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:36.337847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-acae4b1c-682c-4ffd-bf74-1899daed7682 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:36.338355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-acae4b1c-682c-4ffd-bf74-1899daed7682 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:36.339209 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-acae4b1c-682c-4ffd-bf74-1899daed7682 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:36.339702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-acae4b1c-682c-4ffd-bf74-1899daed7682 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:36.472220 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-acae4b1c-682c-4ffd-bf74-1899daed7682 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:36.481610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-acae4b1c-682c-4ffd-bf74-1899daed7682 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.162394 Dec 21 04:15:36.482205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 606/1248] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:36 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:36.975396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-87c72a12-9758-48be-927b-483cc09d917d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:36.976062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-87c72a12-9758-48be-927b-483cc09d917d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:36.984567 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87c72a12-9758-48be-927b-483cc09d917d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:36.985080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87c72a12-9758-48be-927b-483cc09d917d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:36.985910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87c72a12-9758-48be-927b-483cc09d917d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:36.986406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87c72a12-9758-48be-927b-483cc09d917d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:37.119373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-87c72a12-9758-48be-927b-483cc09d917d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:37.134505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-87c72a12-9758-48be-927b-483cc09d917d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:37.141104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-87c72a12-9758-48be-927b-483cc09d917d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:37.142269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-87c72a12-9758-48be-927b-483cc09d917d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.176156 Dec 21 04:15:37.142847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 643/1249] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:36 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:37.727531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f68e94ec-52c8-4ad8-9c8c-04b2ae3db86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:37.728211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f68e94ec-52c8-4ad8-9c8c-04b2ae3db86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:37.736041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f68e94ec-52c8-4ad8-9c8c-04b2ae3db86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:37.736553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f68e94ec-52c8-4ad8-9c8c-04b2ae3db86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:37.737384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f68e94ec-52c8-4ad8-9c8c-04b2ae3db86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:37.737880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f68e94ec-52c8-4ad8-9c8c-04b2ae3db86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:37.867856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f68e94ec-52c8-4ad8-9c8c-04b2ae3db86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:37.876633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f68e94ec-52c8-4ad8-9c8c-04b2ae3db86a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.380721 Dec 21 04:15:37.877231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 607/1250] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:37 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:38.168227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0d5c6399-667d-4ab0-805a-6d0b8f5d18a3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:38.168890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0d5c6399-667d-4ab0-805a-6d0b8f5d18a3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:38.176775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0d5c6399-667d-4ab0-805a-6d0b8f5d18a3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:38.177271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0d5c6399-667d-4ab0-805a-6d0b8f5d18a3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:38.178085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0d5c6399-667d-4ab0-805a-6d0b8f5d18a3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:38.178569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0d5c6399-667d-4ab0-805a-6d0b8f5d18a3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:38.311766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0d5c6399-667d-4ab0-805a-6d0b8f5d18a3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:38.326726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0d5c6399-667d-4ab0-805a-6d0b8f5d18a3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:38.333389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0d5c6399-667d-4ab0-805a-6d0b8f5d18a3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:38.334554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0d5c6399-667d-4ab0-805a-6d0b8f5d18a3 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.176744 Dec 21 04:15:38.335174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 644/1251] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:38 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:38.901320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c782923e-2b3d-4a55-985b-268fe25a3802 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:38.901986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c782923e-2b3d-4a55-985b-268fe25a3802 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:38.910094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c782923e-2b3d-4a55-985b-268fe25a3802 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:38.910545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c782923e-2b3d-4a55-985b-268fe25a3802 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:38.911535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c782923e-2b3d-4a55-985b-268fe25a3802 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:38.912034 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c782923e-2b3d-4a55-985b-268fe25a3802 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:39.044514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c782923e-2b3d-4a55-985b-268fe25a3802 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:39.053276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c782923e-2b3d-4a55-985b-268fe25a3802 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.161752 Dec 21 04:15:39.053868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 608/1252] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:38 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:39.359359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6d3fdf41-e960-4ca0-b0ba-c0080b79473d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:39.360026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6d3fdf41-e960-4ca0-b0ba-c0080b79473d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:39.368638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6d3fdf41-e960-4ca0-b0ba-c0080b79473d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:39.369142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6d3fdf41-e960-4ca0-b0ba-c0080b79473d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:39.369963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6d3fdf41-e960-4ca0-b0ba-c0080b79473d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:39.370456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6d3fdf41-e960-4ca0-b0ba-c0080b79473d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:39.719418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6d3fdf41-e960-4ca0-b0ba-c0080b79473d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:39.734894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6d3fdf41-e960-4ca0-b0ba-c0080b79473d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:39.741732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6d3fdf41-e960-4ca0-b0ba-c0080b79473d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:39.743501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6d3fdf41-e960-4ca0-b0ba-c0080b79473d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.393471 Dec 21 04:15:39.744081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 645/1253] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:39 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:40.076685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e6b57ac0-f8f3-4d0f-b236-40b37e3319fc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:40.077352 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e6b57ac0-f8f3-4d0f-b236-40b37e3319fc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:40.085252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6b57ac0-f8f3-4d0f-b236-40b37e3319fc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:40.086258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6b57ac0-f8f3-4d0f-b236-40b37e3319fc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:40.087121 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6b57ac0-f8f3-4d0f-b236-40b37e3319fc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:40.087614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e6b57ac0-f8f3-4d0f-b236-40b37e3319fc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:40.220489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e6b57ac0-f8f3-4d0f-b236-40b37e3319fc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:40.229439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e6b57ac0-f8f3-4d0f-b236-40b37e3319fc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.161845 Dec 21 04:15:40.230030 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 609/1254] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:40 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:40.769065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b17cdaed-7723-49f0-b91a-210a2b5c7e83 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:40.769667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b17cdaed-7723-49f0-b91a-210a2b5c7e83 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:40.777693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b17cdaed-7723-49f0-b91a-210a2b5c7e83 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:40.778207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b17cdaed-7723-49f0-b91a-210a2b5c7e83 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:40.779064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b17cdaed-7723-49f0-b91a-210a2b5c7e83 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:40.779559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b17cdaed-7723-49f0-b91a-210a2b5c7e83 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:40.909665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b17cdaed-7723-49f0-b91a-210a2b5c7e83 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:40.925125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b17cdaed-7723-49f0-b91a-210a2b5c7e83 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:40.932355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b17cdaed-7723-49f0-b91a-210a2b5c7e83 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:40.933537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b17cdaed-7723-49f0-b91a-210a2b5c7e83 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.173814 Dec 21 04:15:40.934125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 646/1255] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:40 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:41.252778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-302f3e03-2206-4f4b-9298-0fdd280d1554 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:41.253437 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-302f3e03-2206-4f4b-9298-0fdd280d1554 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:41.261542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-302f3e03-2206-4f4b-9298-0fdd280d1554 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:41.262043 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-302f3e03-2206-4f4b-9298-0fdd280d1554 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:41.262867 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-302f3e03-2206-4f4b-9298-0fdd280d1554 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:41.263385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-302f3e03-2206-4f4b-9298-0fdd280d1554 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:41.392975 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-302f3e03-2206-4f4b-9298-0fdd280d1554 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:41.402335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-302f3e03-2206-4f4b-9298-0fdd280d1554 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.159188 Dec 21 04:15:41.402938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 610/1256] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:41 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:41.957922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c570ce40-a454-4ac7-8d49-9b8008f33e07 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:41.958595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c570ce40-a454-4ac7-8d49-9b8008f33e07 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:41.967192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c570ce40-a454-4ac7-8d49-9b8008f33e07 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:41.967706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c570ce40-a454-4ac7-8d49-9b8008f33e07 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:41.968535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c570ce40-a454-4ac7-8d49-9b8008f33e07 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:41.969027 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c570ce40-a454-4ac7-8d49-9b8008f33e07 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:42.102606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c570ce40-a454-4ac7-8d49-9b8008f33e07 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:42.118332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c570ce40-a454-4ac7-8d49-9b8008f33e07 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:42.124937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c570ce40-a454-4ac7-8d49-9b8008f33e07 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:42.126107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c570ce40-a454-4ac7-8d49-9b8008f33e07 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1445 microversion: 2.20 time: 0.177452 Dec 21 04:15:42.126683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 647/1257] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:41 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1445 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:42.425852 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-31bd6016-7fce-42f0-bffc-dc84de586ab0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:42.426517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-31bd6016-7fce-42f0-bffc-dc84de586ab0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:42.435047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31bd6016-7fce-42f0-bffc-dc84de586ab0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:42.435551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31bd6016-7fce-42f0-bffc-dc84de586ab0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:42.436374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31bd6016-7fce-42f0-bffc-dc84de586ab0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:42.436883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-31bd6016-7fce-42f0-bffc-dc84de586ab0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:42.569254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-31bd6016-7fce-42f0-bffc-dc84de586ab0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:42.578327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-31bd6016-7fce-42f0-bffc-dc84de586ab0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.161558 Dec 21 04:15:42.578931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 611/1258] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:42 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:43.151508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:43.152171 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:43.159955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:43.160463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:43.161289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:43.161781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:43.239927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:43.240434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:43.240932 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lazy-loading 'fault' on Instance uuid 37226a3f-240e-4e04-9813-fa3d109452de {{(pid=94299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:15:43.310653 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:43.327262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:43.333970 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:43.335200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-670a9a25-faec-43a9-a064-f426facc0b0a tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 200 len: 1539 microversion: 2.20 time: 0.193626 Dec 21 04:15:43.340960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 648/1259] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:43 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 1539 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:43.601619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-eb25710f-c815-458a-94ab-8da5468e8280 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:43.602284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-eb25710f-c815-458a-94ab-8da5468e8280 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:43.610098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eb25710f-c815-458a-94ab-8da5468e8280 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:43.610606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eb25710f-c815-458a-94ab-8da5468e8280 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:43.611470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eb25710f-c815-458a-94ab-8da5468e8280 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:43.611954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-eb25710f-c815-458a-94ab-8da5468e8280 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:43.872752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-eb25710f-c815-458a-94ab-8da5468e8280 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:43.881534 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-eb25710f-c815-458a-94ab-8da5468e8280 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.289227 Dec 21 04:15:43.882126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 612/1260] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:43 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:44.361575 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c7540f6f-0532-46a4-a664-25ccba911ca0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:44.362233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c7540f6f-0532-46a4-a664-25ccba911ca0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:44.370487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7540f6f-0532-46a4-a664-25ccba911ca0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:44.370963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7540f6f-0532-46a4-a664-25ccba911ca0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:44.371785 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7540f6f-0532-46a4-a664-25ccba911ca0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:44.372271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7540f6f-0532-46a4-a664-25ccba911ca0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:44.425638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-c7540f6f-0532-46a4-a664-25ccba911ca0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] HTTP exception thrown: Instance 37226a3f-240e-4e04-9813-fa3d109452de could not be found. Dec 21 04:15:44.426317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c7540f6f-0532-46a4-a664-25ccba911ca0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Returning 404 to user: Instance 37226a3f-240e-4e04-9813-fa3d109452de could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:15:44.427242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c7540f6f-0532-46a4-a664-25ccba911ca0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 404 len: 111 microversion: 2.20 time: 0.074861 Dec 21 04:15:44.427849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 649/1261] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:44 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 21 04:15:44.442284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a67b7f21-2b8b-403b-8112-a01a8e658ddd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '.version_select at 0x7f2bb9092488>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:44.451178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a67b7f21-2b8b-403b-8112-a01a8e658ddd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [b2b30c15-112e-4183-b087-421967c30c47] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 21 04:15:44.905825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6ca766c4-de9c-4f11-874b-36af26027f72 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:44.906428 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6ca766c4-de9c-4f11-874b-36af26027f72 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:44.914531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ca766c4-de9c-4f11-874b-36af26027f72 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:44.915063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ca766c4-de9c-4f11-874b-36af26027f72 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:44.915887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ca766c4-de9c-4f11-874b-36af26027f72 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:44.916378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6ca766c4-de9c-4f11-874b-36af26027f72 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:45.044438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6ca766c4-de9c-4f11-874b-36af26027f72 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:45.053129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6ca766c4-de9c-4f11-874b-36af26027f72 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.157142 Dec 21 04:15:45.053719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 650/1262] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:44 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:45.468157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [None req-a67b7f21-2b8b-403b-8112-a01a8e658ddd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [b2b30c15-112e-4183-b087-421967c30c47] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56930. Dec 21 04:15:45.485147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a67b7f21-2b8b-403b-8112-a01a8e658ddd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110262630" status: 204 len: 0 microversion: 2.20 time: 1.052145 Dec 21 04:15:45.485819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 613/1263] 10.222.0.16 () {60 vars in 1252 bytes} [Mon Dec 21 04:15:44 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110262630 => generated 0 bytes in 1054 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 21 04:15:46.077096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-425d52c0-ff76-4070-b0be-88983f00f348 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:46.077767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-425d52c0-ff76-4070-b0be-88983f00f348 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:46.086205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-425d52c0-ff76-4070-b0be-88983f00f348 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:46.086713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-425d52c0-ff76-4070-b0be-88983f00f348 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:46.087569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-425d52c0-ff76-4070-b0be-88983f00f348 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:46.088061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-425d52c0-ff76-4070-b0be-88983f00f348 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:46.221962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-425d52c0-ff76-4070-b0be-88983f00f348 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:46.233041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-425d52c0-ff76-4070-b0be-88983f00f348 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.165164 Dec 21 04:15:46.244170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 651/1264] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:46 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:46.427542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:15:46.427715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:15:46 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:15:46.736859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4afb836b-e374-4faa-8ba7-467cc4cd5174 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'create', calling method: .version_select at 0x7f2bb83abd08>, body: {"keypair": {"name": "tempest-keypair-606155027"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:15:46.767153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-4afb836b-e374-4faa-8ba7-467cc4cd5174 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Getting quotas for project cc8f76dafd9d4e19a9667dec5becb673. Resources: {'key_pairs'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:15:46.771333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-4afb836b-e374-4faa-8ba7-467cc4cd5174 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Getting quotas for user 72d106173cd04d2e839770d14d8731a5 and project cc8f76dafd9d4e19a9667dec5becb673. Resources: {'key_pairs'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:15:47.103864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-4afb836b-e374-4faa-8ba7-467cc4cd5174 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Getting quotas for project cc8f76dafd9d4e19a9667dec5becb673. Resources: {'key_pairs'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:15:47.107977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-4afb836b-e374-4faa-8ba7-467cc4cd5174 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Getting quotas for user 72d106173cd04d2e839770d14d8731a5 and project cc8f76dafd9d4e19a9667dec5becb673. Resources: {'key_pairs'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:15:47.122445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4afb836b-e374-4faa-8ba7-467cc4cd5174 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.395260 Dec 21 04:15:47.123171 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 614/1265] 10.222.0.16 () {62 vars in 1189 bytes} [Mon Dec 21 04:15:46 2020] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 397 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 21 04:15:47.258368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a23602ba-2437-4137-ac02-9d949384c0ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:47.259064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a23602ba-2437-4137-ac02-9d949384c0ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:47.267198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a23602ba-2437-4137-ac02-9d949384c0ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:47.267703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a23602ba-2437-4137-ac02-9d949384c0ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:47.268526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a23602ba-2437-4137-ac02-9d949384c0ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:47.269015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a23602ba-2437-4137-ac02-9d949384c0ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:47.413079 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a23602ba-2437-4137-ac02-9d949384c0ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:47.430449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a23602ba-2437-4137-ac02-9d949384c0ef tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.174482 Dec 21 04:15:47.430449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 652/1266] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:47 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:48.447891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4b484dee-c901-4c8f-b696-8ecf8bd83cac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:48.449112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4b484dee-c901-4c8f-b696-8ecf8bd83cac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:48.466535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b484dee-c901-4c8f-b696-8ecf8bd83cac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:48.467075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b484dee-c901-4c8f-b696-8ecf8bd83cac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:48.467939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b484dee-c901-4c8f-b696-8ecf8bd83cac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:48.468430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b484dee-c901-4c8f-b696-8ecf8bd83cac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:48.610569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4b484dee-c901-4c8f-b696-8ecf8bd83cac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:48.620377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4b484dee-c901-4c8f-b696-8ecf8bd83cac tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.183974 Dec 21 04:15:48.620989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 615/1267] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:48 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:49.451191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1071801411", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6bc0051-d4ea-476a-9024-7792973f8f69"}], "security_groups": [{"name": "tempest-securitygroup--1509233784"}], "key_name": "tempest-keypair-606155027", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:15:49.577267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] validate_networks() for [('f6bc0051-d4ea-476a-9024-7792973f8f69', None, None, None)] {{(pid=94299) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:15:49.644505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-49e8c7ba-4a69-4d51-bb9f-ab9424746692 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:49.645291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-49e8c7ba-4a69-4d51-bb9f-ab9424746692 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:49.654725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49e8c7ba-4a69-4d51-bb9f-ab9424746692 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:49.655386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49e8c7ba-4a69-4d51-bb9f-ab9424746692 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:49.656330 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49e8c7ba-4a69-4d51-bb9f-ab9424746692 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:49.656922 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49e8c7ba-4a69-4d51-bb9f-ab9424746692 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:49.793756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-49e8c7ba-4a69-4d51-bb9f-ab9424746692 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:49.802657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-49e8c7ba-4a69-4d51-bb9f-ab9424746692 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.168344 Dec 21 04:15:49.803303 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 616/1268] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:49 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:50.164876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Flavor limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:15:50.165346 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Image limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:15:50.165887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Flavor pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:15:50.166346 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Image pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:15:50.166808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:15:50.175771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:50.176282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:50.177153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:50.177656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:50.196970 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Getting quotas for project cc8f76dafd9d4e19a9667dec5becb673. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:15:50.201261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Getting quotas for user 72d106173cd04d2e839770d14d8731a5 and project cc8f76dafd9d4e19a9667dec5becb673. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:15:50.213098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Going to run 1 instances... {{(pid=94299) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:15:50.215709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:15:50.271439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-de0593b0-0647-4f16-b1c3-c8d15fea6cfd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.830169 Dec 21 04:15:50.272291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 653/1269] 10.222.0.16 () {62 vars in 1178 bytes} [Mon Dec 21 04:15:49 2020] POST /compute/v2.1/servers => generated 402 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 21 04:15:50.288734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ca41a8a6-0192-461b-a220-1fe049812e16 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:50.299497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ca41a8a6-0192-461b-a220-1fe049812e16 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:50.405585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ca41a8a6-0192-461b-a220-1fe049812e16 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:50.419657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ca41a8a6-0192-461b-a220-1fe049812e16 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:50.426175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ca41a8a6-0192-461b-a220-1fe049812e16 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:50.427318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ca41a8a6-0192-461b-a220-1fe049812e16 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 200 len: 1281 microversion: 2.20 time: 0.147632 Dec 21 04:15:50.427884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 617/1270] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:50 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 1281 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:50.831736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a949c6bb-1996-4870-8852-f0b2c06a37cc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:50.832439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a949c6bb-1996-4870-8852-f0b2c06a37cc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:50.842946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a949c6bb-1996-4870-8852-f0b2c06a37cc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:50.843474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a949c6bb-1996-4870-8852-f0b2c06a37cc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:50.844307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a949c6bb-1996-4870-8852-f0b2c06a37cc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:50.844801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a949c6bb-1996-4870-8852-f0b2c06a37cc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:50.992395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a949c6bb-1996-4870-8852-f0b2c06a37cc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:51.001416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a949c6bb-1996-4870-8852-f0b2c06a37cc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.183610 Dec 21 04:15:51.001961 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 654/1271] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:50 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:51.452486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b9238f6b-a713-4311-9a51-1e691d15b828 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:51.453473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b9238f6b-a713-4311-9a51-1e691d15b828 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:51.462664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b9238f6b-a713-4311-9a51-1e691d15b828 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:51.463265 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b9238f6b-a713-4311-9a51-1e691d15b828 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:51.464119 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b9238f6b-a713-4311-9a51-1e691d15b828 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:51.464621 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b9238f6b-a713-4311-9a51-1e691d15b828 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:51.837788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b9238f6b-a713-4311-9a51-1e691d15b828 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:51.856029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b9238f6b-a713-4311-9a51-1e691d15b828 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:51.862728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b9238f6b-a713-4311-9a51-1e691d15b828 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:51.863986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b9238f6b-a713-4311-9a51-1e691d15b828 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 200 len: 1333 microversion: 2.20 time: 0.421259 Dec 21 04:15:51.864855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 618/1272] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:51 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 1333 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:52.024749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-50344e4e-a5a5-4e29-ac19-87855e64ce8e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:52.025358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-50344e4e-a5a5-4e29-ac19-87855e64ce8e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:52.033553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50344e4e-a5a5-4e29-ac19-87855e64ce8e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:52.034073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50344e4e-a5a5-4e29-ac19-87855e64ce8e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:52.034951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50344e4e-a5a5-4e29-ac19-87855e64ce8e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:52.035455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50344e4e-a5a5-4e29-ac19-87855e64ce8e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:52.172141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-50344e4e-a5a5-4e29-ac19-87855e64ce8e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:52.181813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-50344e4e-a5a5-4e29-ac19-87855e64ce8e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.166222 Dec 21 04:15:52.182399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 655/1273] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:52 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:52.889176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a1c10241-7840-44dc-ae98-169155dab548 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:52.889856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a1c10241-7840-44dc-ae98-169155dab548 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:52.898219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a1c10241-7840-44dc-ae98-169155dab548 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:52.898706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a1c10241-7840-44dc-ae98-169155dab548 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:52.899820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a1c10241-7840-44dc-ae98-169155dab548 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:52.900315 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a1c10241-7840-44dc-ae98-169155dab548 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:53.206715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bff224c3-050e-4040-b6f5-4e9604a3dac3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:53.207564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bff224c3-050e-4040-b6f5-4e9604a3dac3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:53.216017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bff224c3-050e-4040-b6f5-4e9604a3dac3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:53.216656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bff224c3-050e-4040-b6f5-4e9604a3dac3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:53.217609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bff224c3-050e-4040-b6f5-4e9604a3dac3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:53.218213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bff224c3-050e-4040-b6f5-4e9604a3dac3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:53.265869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a1c10241-7840-44dc-ae98-169155dab548 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:53.295686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a1c10241-7840-44dc-ae98-169155dab548 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:53.302400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a1c10241-7840-44dc-ae98-169155dab548 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:53.303570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a1c10241-7840-44dc-ae98-169155dab548 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 200 len: 1407 microversion: 2.20 time: 0.423546 Dec 21 04:15:53.304772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 619/1274] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:52 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 1407 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:53.385548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bff224c3-050e-4040-b6f5-4e9604a3dac3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:53.395984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bff224c3-050e-4040-b6f5-4e9604a3dac3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.199356 Dec 21 04:15:53.396972 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 656/1275] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:53 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:54.328167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ca75f17a-2eda-4e36-a787-3f7c758a3a82 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:54.328834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ca75f17a-2eda-4e36-a787-3f7c758a3a82 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:54.337266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca75f17a-2eda-4e36-a787-3f7c758a3a82 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:54.337770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca75f17a-2eda-4e36-a787-3f7c758a3a82 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:54.338613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca75f17a-2eda-4e36-a787-3f7c758a3a82 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:54.339187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca75f17a-2eda-4e36-a787-3f7c758a3a82 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:54.421113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-90b6989b-837b-488a-9d68-2370dc6978cd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:54.421775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-90b6989b-837b-488a-9d68-2370dc6978cd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:54.435311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90b6989b-837b-488a-9d68-2370dc6978cd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:54.435814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90b6989b-837b-488a-9d68-2370dc6978cd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:54.436656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90b6989b-837b-488a-9d68-2370dc6978cd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:54.437144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-90b6989b-837b-488a-9d68-2370dc6978cd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:54.589024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-90b6989b-837b-488a-9d68-2370dc6978cd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:54.598960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-90b6989b-837b-488a-9d68-2370dc6978cd tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.187352 Dec 21 04:15:54.599788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 657/1276] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:54 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:54.610839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-e5bb0d36-d7fb-40d6-b06b-9082a15da75a req-77d978dc-332f-46d1-b10c-680de2a9be5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a45700-cf5d-492c-8293-19841bf629a4", "tag": "56bbeacb-aa11-4389-9729-35e21814ae56"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:15:54.618960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:54.618960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:15:54.629211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-e5bb0d36-d7fb-40d6-b06b-9082a15da75a req-77d978dc-332f-46d1-b10c-680de2a9be5f service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:54.630024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-e5bb0d36-d7fb-40d6-b06b-9082a15da75a req-77d978dc-332f-46d1-b10c-680de2a9be5f service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:54.663962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-e5bb0d36-d7fb-40d6-b06b-9082a15da75a req-77d978dc-332f-46d1-b10c-680de2a9be5f service nova] Creating event network-changed:56bbeacb-aa11-4389-9729-35e21814ae56 for instance b9a45700-cf5d-492c-8293-19841bf629a4 on hv-cinder-73306 Dec 21 04:15:54.669544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-e5bb0d36-d7fb-40d6-b06b-9082a15da75a req-77d978dc-332f-46d1-b10c-680de2a9be5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068280 Dec 21 04:15:54.670843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 658/1277] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:15:54 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:15:54.723206 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ca75f17a-2eda-4e36-a787-3f7c758a3a82 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:54.739747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ca75f17a-2eda-4e36-a787-3f7c758a3a82 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:54.756299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ca75f17a-2eda-4e36-a787-3f7c758a3a82 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:54.756299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ca75f17a-2eda-4e36-a787-3f7c758a3a82 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 200 len: 1407 microversion: 2.20 time: 0.430541 Dec 21 04:15:54.756299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 620/1278] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:54 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 1407 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:55.624975 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-30ab9451-a06d-4ae6-ad80-82f3b251b5c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:55.626139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-30ab9451-a06d-4ae6-ad80-82f3b251b5c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:55.636696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30ab9451-a06d-4ae6-ad80-82f3b251b5c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:55.637133 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30ab9451-a06d-4ae6-ad80-82f3b251b5c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:55.638031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30ab9451-a06d-4ae6-ad80-82f3b251b5c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:55.638567 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30ab9451-a06d-4ae6-ad80-82f3b251b5c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:55.774916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f06eaff1-1242-4dd0-9e73-749a623a008d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:55.775890 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f06eaff1-1242-4dd0-9e73-749a623a008d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:55.779252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-30ab9451-a06d-4ae6-ad80-82f3b251b5c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:55.785704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f06eaff1-1242-4dd0-9e73-749a623a008d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:55.786444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f06eaff1-1242-4dd0-9e73-749a623a008d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:55.787652 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f06eaff1-1242-4dd0-9e73-749a623a008d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:55.788438 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f06eaff1-1242-4dd0-9e73-749a623a008d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:55.790440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-30ab9451-a06d-4ae6-ad80-82f3b251b5c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.176461 Dec 21 04:15:55.791104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 659/1279] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:55 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:56.459341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f06eaff1-1242-4dd0-9e73-749a623a008d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:56.477532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f06eaff1-1242-4dd0-9e73-749a623a008d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:56.484396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f06eaff1-1242-4dd0-9e73-749a623a008d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:56.485570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f06eaff1-1242-4dd0-9e73-749a623a008d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 200 len: 1407 microversion: 2.20 time: 0.721045 Dec 21 04:15:56.486409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 621/1280] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:55 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 1407 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:56.813804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2f73c3f5-9812-4bc3-90ee-de19d5cc5bbc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:56.814575 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2f73c3f5-9812-4bc3-90ee-de19d5cc5bbc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:56.823275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2f73c3f5-9812-4bc3-90ee-de19d5cc5bbc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:56.823882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2f73c3f5-9812-4bc3-90ee-de19d5cc5bbc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:56.824886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2f73c3f5-9812-4bc3-90ee-de19d5cc5bbc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:56.825460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2f73c3f5-9812-4bc3-90ee-de19d5cc5bbc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:56.966412 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2f73c3f5-9812-4bc3-90ee-de19d5cc5bbc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:56.982885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2f73c3f5-9812-4bc3-90ee-de19d5cc5bbc tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.172176 Dec 21 04:15:56.982885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 660/1281] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:56 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:57.510247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c45615c2-daae-4fae-bc23-bec0a2881344 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:57.510934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c45615c2-daae-4fae-bc23-bec0a2881344 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:57.518680 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c45615c2-daae-4fae-bc23-bec0a2881344 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:57.519220 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c45615c2-daae-4fae-bc23-bec0a2881344 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:57.520045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c45615c2-daae-4fae-bc23-bec0a2881344 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:57.520531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c45615c2-daae-4fae-bc23-bec0a2881344 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:57.740267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c45615c2-daae-4fae-bc23-bec0a2881344 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:57.755622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c45615c2-daae-4fae-bc23-bec0a2881344 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:57.762120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c45615c2-daae-4fae-bc23-bec0a2881344 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:57.763310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c45615c2-daae-4fae-bc23-bec0a2881344 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 200 len: 1407 microversion: 2.20 time: 0.262217 Dec 21 04:15:57.763893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 622/1282] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:57 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:58.005080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d4ccfc16-368a-4f1f-8dc7-0a5077dd935d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:58.005702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d4ccfc16-368a-4f1f-8dc7-0a5077dd935d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:58.013721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4ccfc16-368a-4f1f-8dc7-0a5077dd935d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:58.014251 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4ccfc16-368a-4f1f-8dc7-0a5077dd935d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:58.015107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4ccfc16-368a-4f1f-8dc7-0a5077dd935d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:58.015609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4ccfc16-368a-4f1f-8dc7-0a5077dd935d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:58.150545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d4ccfc16-368a-4f1f-8dc7-0a5077dd935d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:58.159447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d4ccfc16-368a-4f1f-8dc7-0a5077dd935d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.163362 Dec 21 04:15:58.160054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 661/1283] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:57 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:15:58.788056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8bc58c6c-e2a3-4e95-8196-f61e3fb4be0e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:58.788728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8bc58c6c-e2a3-4e95-8196-f61e3fb4be0e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:58.796649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8bc58c6c-e2a3-4e95-8196-f61e3fb4be0e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:58.797161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8bc58c6c-e2a3-4e95-8196-f61e3fb4be0e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:58.797995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8bc58c6c-e2a3-4e95-8196-f61e3fb4be0e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:58.798490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8bc58c6c-e2a3-4e95-8196-f61e3fb4be0e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:59.033272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8bc58c6c-e2a3-4e95-8196-f61e3fb4be0e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:59.049416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8bc58c6c-e2a3-4e95-8196-f61e3fb4be0e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:59.056713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8bc58c6c-e2a3-4e95-8196-f61e3fb4be0e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:59.057950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8bc58c6c-e2a3-4e95-8196-f61e3fb4be0e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 200 len: 1407 microversion: 2.20 time: 0.279172 Dec 21 04:15:59.058523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 623/1284] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:15:58 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:15:59.183705 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-366796fc-ee90-4e28-b3d9-c9f551942510 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:15:59.184389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-366796fc-ee90-4e28-b3d9-c9f551942510 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:15:59.193364 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-366796fc-ee90-4e28-b3d9-c9f551942510 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:59.193871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-366796fc-ee90-4e28-b3d9-c9f551942510 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:59.194786 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-366796fc-ee90-4e28-b3d9-c9f551942510 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:59.195305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-366796fc-ee90-4e28-b3d9-c9f551942510 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:59.293604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-3a66ae8e-d5e9-4641-bc58-f05d3c478796 req-9d10f78e-0704-45af-b7fc-556fff430523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a45700-cf5d-492c-8293-19841bf629a4", "name": "network-vif-plugged", "status": "completed", "tag": "56bbeacb-aa11-4389-9729-35e21814ae56"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:15:59.301590 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:59.301590 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:15:59.311501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-3a66ae8e-d5e9-4641-bc58-f05d3c478796 req-9d10f78e-0704-45af-b7fc-556fff430523 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:15:59.312000 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-3a66ae8e-d5e9-4641-bc58-f05d3c478796 req-9d10f78e-0704-45af-b7fc-556fff430523 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:15:59.330221 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-3a66ae8e-d5e9-4641-bc58-f05d3c478796 req-9d10f78e-0704-45af-b7fc-556fff430523 service nova] Creating event network-vif-plugged:56bbeacb-aa11-4389-9729-35e21814ae56 for instance b9a45700-cf5d-492c-8293-19841bf629a4 on hv-cinder-73306 Dec 21 04:15:59.335617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-3a66ae8e-d5e9-4641-bc58-f05d3c478796 req-9d10f78e-0704-45af-b7fc-556fff430523 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169070 Dec 21 04:15:59.336444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 662/1285] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:15:59 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:15:59.344731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-366796fc-ee90-4e28-b3d9-c9f551942510 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:15:59.354015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-366796fc-ee90-4e28-b3d9-c9f551942510 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.179989 Dec 21 04:15:59.354655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 624/1286] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:15:59 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:16:00.082639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e4d6d267-bd82-48d6-839c-eb631191f403 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:00.083428 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e4d6d267-bd82-48d6-839c-eb631191f403 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:00.091949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4d6d267-bd82-48d6-839c-eb631191f403 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:00.092459 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4d6d267-bd82-48d6-839c-eb631191f403 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:00.093289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4d6d267-bd82-48d6-839c-eb631191f403 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:00.093783 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e4d6d267-bd82-48d6-839c-eb631191f403 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:00.314749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e4d6d267-bd82-48d6-839c-eb631191f403 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:00.329210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e4d6d267-bd82-48d6-839c-eb631191f403 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:00.337485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e4d6d267-bd82-48d6-839c-eb631191f403 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:00.338628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e4d6d267-bd82-48d6-839c-eb631191f403 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 200 len: 1407 microversion: 2.20 time: 0.265712 Dec 21 04:16:00.339379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 663/1287] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:16:00 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:16:00.377602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a424e2cf-434e-45fd-8cdd-15face54e6c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:00.378270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a424e2cf-434e-45fd-8cdd-15face54e6c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:00.386083 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a424e2cf-434e-45fd-8cdd-15face54e6c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:00.386595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a424e2cf-434e-45fd-8cdd-15face54e6c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:00.387450 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a424e2cf-434e-45fd-8cdd-15face54e6c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:00.387945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a424e2cf-434e-45fd-8cdd-15face54e6c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:00.525304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a424e2cf-434e-45fd-8cdd-15face54e6c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:00.534221 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a424e2cf-434e-45fd-8cdd-15face54e6c3 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.165596 Dec 21 04:16:00.534810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 625/1288] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:00 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:01.362765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d56b0deb-6ad0-4605-8403-52a497293898 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:01.363459 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d56b0deb-6ad0-4605-8403-52a497293898 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:01.371563 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d56b0deb-6ad0-4605-8403-52a497293898 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:01.372069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d56b0deb-6ad0-4605-8403-52a497293898 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:01.372900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d56b0deb-6ad0-4605-8403-52a497293898 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:01.373387 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d56b0deb-6ad0-4605-8403-52a497293898 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:01.557871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4c29b5f1-72d1-455f-89aa-7c6ee1216e42 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:01.558531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4c29b5f1-72d1-455f-89aa-7c6ee1216e42 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:01.566305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c29b5f1-72d1-455f-89aa-7c6ee1216e42 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:01.566813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c29b5f1-72d1-455f-89aa-7c6ee1216e42 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:01.567674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c29b5f1-72d1-455f-89aa-7c6ee1216e42 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:01.568160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4c29b5f1-72d1-455f-89aa-7c6ee1216e42 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:01.593110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d56b0deb-6ad0-4605-8403-52a497293898 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:01.607707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d56b0deb-6ad0-4605-8403-52a497293898 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:01.614158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d56b0deb-6ad0-4605-8403-52a497293898 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:01.615373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d56b0deb-6ad0-4605-8403-52a497293898 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 200 len: 1598 microversion: 2.20 time: 0.261762 Dec 21 04:16:01.626923 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 664/1289] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:16:01 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 1598 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:16:01.641449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7c93f94f-25eb-4854-be52-195045a27b70 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:01.642036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7c93f94f-25eb-4854-be52-195045a27b70 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:01.650196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7c93f94f-25eb-4854-be52-195045a27b70 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:01.650710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7c93f94f-25eb-4854-be52-195045a27b70 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:01.651583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7c93f94f-25eb-4854-be52-195045a27b70 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:01.652081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7c93f94f-25eb-4854-be52-195045a27b70 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:01.701845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4c29b5f1-72d1-455f-89aa-7c6ee1216e42 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:01.711087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4c29b5f1-72d1-455f-89aa-7c6ee1216e42 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.162665 Dec 21 04:16:01.712101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 626/1290] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:01 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:01.814680 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7c93f94f-25eb-4854-be52-195045a27b70 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.182872 Dec 21 04:16:01.815402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 665/1291] 10.222.0.16 () {60 vars in 1306 bytes} [Mon Dec 21 04:16:01 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 21 04:16:02.734554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7f619c64-402a-4c30-81d9-77a1434a6213 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:02.735254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7f619c64-402a-4c30-81d9-77a1434a6213 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:02.743773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f619c64-402a-4c30-81d9-77a1434a6213 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:02.744276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f619c64-402a-4c30-81d9-77a1434a6213 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:02.745115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f619c64-402a-4c30-81d9-77a1434a6213 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:02.745607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f619c64-402a-4c30-81d9-77a1434a6213 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:02.888191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7f619c64-402a-4c30-81d9-77a1434a6213 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:02.898126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7f619c64-402a-4c30-81d9-77a1434a6213 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.172191 Dec 21 04:16:02.899316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 627/1292] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:02 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:03.545777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5682913c-0513-4aac-b1c0-f1b8feff462b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:03.546971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5682913c-0513-4aac-b1c0-f1b8feff462b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:03.549853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-e2c98e98-cd38-47c2-88d5-8dedce28a675 req-9801130b-abed-4267-9970-885385a687df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a45700-cf5d-492c-8293-19841bf629a4", "tag": "56bbeacb-aa11-4389-9729-35e21814ae56"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:03.555019 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5682913c-0513-4aac-b1c0-f1b8feff462b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:03.555532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5682913c-0513-4aac-b1c0-f1b8feff462b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:03.556380 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5682913c-0513-4aac-b1c0-f1b8feff462b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:03.557063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5682913c-0513-4aac-b1c0-f1b8feff462b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:03.558958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:03.558958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:16:03.570753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-e2c98e98-cd38-47c2-88d5-8dedce28a675 req-9801130b-abed-4267-9970-885385a687df service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:03.571737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-e2c98e98-cd38-47c2-88d5-8dedce28a675 req-9801130b-abed-4267-9970-885385a687df service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:03.594781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-e2c98e98-cd38-47c2-88d5-8dedce28a675 req-9801130b-abed-4267-9970-885385a687df service nova] Creating event network-changed:56bbeacb-aa11-4389-9729-35e21814ae56 for instance b9a45700-cf5d-492c-8293-19841bf629a4 on hv-cinder-73306 Dec 21 04:16:03.603755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-e2c98e98-cd38-47c2-88d5-8dedce28a675 req-9801130b-abed-4267-9970-885385a687df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064259 Dec 21 04:16:03.604703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 628/1293] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:16:03 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:16:03.671562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5682913c-0513-4aac-b1c0-f1b8feff462b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 14 microversion: 2.20 time: 0.134739 Dec 21 04:16:03.672541 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 666/1294] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:03 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:03.923307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3d342fe9-a658-47c8-b273-a23487a76726 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:03.924901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3d342fe9-a658-47c8-b273-a23487a76726 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:03.936605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d342fe9-a658-47c8-b273-a23487a76726 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:03.937421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d342fe9-a658-47c8-b273-a23487a76726 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:03.938645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d342fe9-a658-47c8-b273-a23487a76726 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:03.939376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3d342fe9-a658-47c8-b273-a23487a76726 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:04.102440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3d342fe9-a658-47c8-b273-a23487a76726 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:04.111836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3d342fe9-a658-47c8-b273-a23487a76726 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.199339 Dec 21 04:16:04.112650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 629/1295] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:03 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:04.689393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-62c80eb3-353e-40cc-bcdb-cc9047249d11 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:04.690853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-62c80eb3-353e-40cc-bcdb-cc9047249d11 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:04.700039 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62c80eb3-353e-40cc-bcdb-cc9047249d11 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:04.700548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62c80eb3-353e-40cc-bcdb-cc9047249d11 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:04.701391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62c80eb3-353e-40cc-bcdb-cc9047249d11 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:04.701883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-62c80eb3-353e-40cc-bcdb-cc9047249d11 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:04.813344 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-62c80eb3-353e-40cc-bcdb-cc9047249d11 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 14 microversion: 2.20 time: 0.133814 Dec 21 04:16:04.816960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 667/1296] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:04 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:05.137046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f1afd192-aedc-4f1b-a699-949756882b52 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:05.137721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f1afd192-aedc-4f1b-a699-949756882b52 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:05.145810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f1afd192-aedc-4f1b-a699-949756882b52 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:05.146323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f1afd192-aedc-4f1b-a699-949756882b52 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:05.147767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f1afd192-aedc-4f1b-a699-949756882b52 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:05.148454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f1afd192-aedc-4f1b-a699-949756882b52 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:05.279904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f1afd192-aedc-4f1b-a699-949756882b52 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:05.289911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f1afd192-aedc-4f1b-a699-949756882b52 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.163764 Dec 21 04:16:05.290515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 630/1297] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:05 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:05.831428 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2ca6be0b-49a0-46cb-9642-8bfadee665c2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:05.832684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2ca6be0b-49a0-46cb-9642-8bfadee665c2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:05.842135 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ca6be0b-49a0-46cb-9642-8bfadee665c2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:05.842642 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ca6be0b-49a0-46cb-9642-8bfadee665c2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:05.843507 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ca6be0b-49a0-46cb-9642-8bfadee665c2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:05.843993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2ca6be0b-49a0-46cb-9642-8bfadee665c2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:05.947382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2ca6be0b-49a0-46cb-9642-8bfadee665c2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 14 microversion: 2.20 time: 0.125444 Dec 21 04:16:05.948047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 668/1298] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:05 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:06.313794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4be23f86-dc9f-4587-8d67-7851512c790f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:06.314404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4be23f86-dc9f-4587-8d67-7851512c790f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:06.322833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4be23f86-dc9f-4587-8d67-7851512c790f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:06.323372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4be23f86-dc9f-4587-8d67-7851512c790f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:06.324231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4be23f86-dc9f-4587-8d67-7851512c790f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:06.324710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4be23f86-dc9f-4587-8d67-7851512c790f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:06.455000 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4be23f86-dc9f-4587-8d67-7851512c790f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:06.464396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4be23f86-dc9f-4587-8d67-7851512c790f tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.159841 Dec 21 04:16:06.465000 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 631/1299] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:06 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:06.964602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1c35be3e-7ef5-48ac-8451-49b07419ca9d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:06.965742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1c35be3e-7ef5-48ac-8451-49b07419ca9d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:06.974355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1c35be3e-7ef5-48ac-8451-49b07419ca9d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:06.974859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1c35be3e-7ef5-48ac-8451-49b07419ca9d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:06.976388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1c35be3e-7ef5-48ac-8451-49b07419ca9d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:06.976875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1c35be3e-7ef5-48ac-8451-49b07419ca9d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:07.079546 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1c35be3e-7ef5-48ac-8451-49b07419ca9d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 14 microversion: 2.20 time: 0.125113 Dec 21 04:16:07.080214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 669/1300] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:06 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:07.487477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-26064260-343a-4b04-b5ac-c042a2ea3710 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:07.488076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-26064260-343a-4b04-b5ac-c042a2ea3710 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:07.496702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26064260-343a-4b04-b5ac-c042a2ea3710 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:07.497205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26064260-343a-4b04-b5ac-c042a2ea3710 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:07.498032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26064260-343a-4b04-b5ac-c042a2ea3710 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:07.498519 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-26064260-343a-4b04-b5ac-c042a2ea3710 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:07.633134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-26064260-343a-4b04-b5ac-c042a2ea3710 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:07.641842 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-26064260-343a-4b04-b5ac-c042a2ea3710 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.163781 Dec 21 04:16:07.642422 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 632/1301] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:07 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:08.097534 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-82715906-cd88-47d7-ab7a-5792be34945b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:08.098667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-82715906-cd88-47d7-ab7a-5792be34945b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:08.107748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-82715906-cd88-47d7-ab7a-5792be34945b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:08.108253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-82715906-cd88-47d7-ab7a-5792be34945b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:08.109079 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-82715906-cd88-47d7-ab7a-5792be34945b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:08.109570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-82715906-cd88-47d7-ab7a-5792be34945b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:08.209816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-82715906-cd88-47d7-ab7a-5792be34945b tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 14 microversion: 2.20 time: 0.122224 Dec 21 04:16:08.210647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 670/1302] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:08 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:08.665693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-03b5cac0-6ddd-40d0-a43b-12da9907fe1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:08.666303 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-03b5cac0-6ddd-40d0-a43b-12da9907fe1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:08.674194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03b5cac0-6ddd-40d0-a43b-12da9907fe1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:08.674709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03b5cac0-6ddd-40d0-a43b-12da9907fe1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:08.675565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03b5cac0-6ddd-40d0-a43b-12da9907fe1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:08.676060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-03b5cac0-6ddd-40d0-a43b-12da9907fe1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:09.032297 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-03b5cac0-6ddd-40d0-a43b-12da9907fe1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:09.042188 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-03b5cac0-6ddd-40d0-a43b-12da9907fe1b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.386314 Dec 21 04:16:09.042787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 633/1303] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:08 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:09.227693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8e6d4580-bde6-45a9-baa4-dc1935c36df5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:09.228764 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8e6d4580-bde6-45a9-baa4-dc1935c36df5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:09.237373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e6d4580-bde6-45a9-baa4-dc1935c36df5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:09.237878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e6d4580-bde6-45a9-baa4-dc1935c36df5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:09.238711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e6d4580-bde6-45a9-baa4-dc1935c36df5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:09.239238 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e6d4580-bde6-45a9-baa4-dc1935c36df5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:09.342939 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8e6d4580-bde6-45a9-baa4-dc1935c36df5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 14 microversion: 2.20 time: 0.125535 Dec 21 04:16:09.344690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 671/1304] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:09 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:10.065569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-be5c37c8-15d4-48ad-adc6-ad4c261bea71 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:10.066242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-be5c37c8-15d4-48ad-adc6-ad4c261bea71 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:10.074469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be5c37c8-15d4-48ad-adc6-ad4c261bea71 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:10.075047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be5c37c8-15d4-48ad-adc6-ad4c261bea71 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:10.075898 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be5c37c8-15d4-48ad-adc6-ad4c261bea71 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:10.076395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be5c37c8-15d4-48ad-adc6-ad4c261bea71 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:10.207958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-be5c37c8-15d4-48ad-adc6-ad4c261bea71 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:10.217466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-be5c37c8-15d4-48ad-adc6-ad4c261bea71 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.161084 Dec 21 04:16:10.218054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 634/1305] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:10 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:10.360467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e72b4ab9-f8a1-4a8e-beb7-6ee6bc8a5955 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:10.361725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e72b4ab9-f8a1-4a8e-beb7-6ee6bc8a5955 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:10.371198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e72b4ab9-f8a1-4a8e-beb7-6ee6bc8a5955 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:10.371705 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e72b4ab9-f8a1-4a8e-beb7-6ee6bc8a5955 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:10.372524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e72b4ab9-f8a1-4a8e-beb7-6ee6bc8a5955 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:10.373008 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e72b4ab9-f8a1-4a8e-beb7-6ee6bc8a5955 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:10.483840 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e72b4ab9-f8a1-4a8e-beb7-6ee6bc8a5955 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 14 microversion: 2.20 time: 0.133334 Dec 21 04:16:10.487497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 672/1306] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:10 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:11.241129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c68a47c5-5fa6-4f5a-8e98-2b84650dad53 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:11.242055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c68a47c5-5fa6-4f5a-8e98-2b84650dad53 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:11.249895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c68a47c5-5fa6-4f5a-8e98-2b84650dad53 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:11.250409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c68a47c5-5fa6-4f5a-8e98-2b84650dad53 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:11.251298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c68a47c5-5fa6-4f5a-8e98-2b84650dad53 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:11.252228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c68a47c5-5fa6-4f5a-8e98-2b84650dad53 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:11.388532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c68a47c5-5fa6-4f5a-8e98-2b84650dad53 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:11.397406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c68a47c5-5fa6-4f5a-8e98-2b84650dad53 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.165434 Dec 21 04:16:11.397938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 635/1307] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:11 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:11.501997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bacfee43-e075-4fea-a94c-b68dd57a9fcb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:11.503168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bacfee43-e075-4fea-a94c-b68dd57a9fcb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:11.512587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bacfee43-e075-4fea-a94c-b68dd57a9fcb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:11.513098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bacfee43-e075-4fea-a94c-b68dd57a9fcb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:11.513930 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bacfee43-e075-4fea-a94c-b68dd57a9fcb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:11.514419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bacfee43-e075-4fea-a94c-b68dd57a9fcb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:11.616924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bacfee43-e075-4fea-a94c-b68dd57a9fcb tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 14 microversion: 2.20 time: 0.123538 Dec 21 04:16:11.617723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 673/1308] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:11 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:12.421051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f2273e85-eab6-4092-9c27-47e9324dc4e0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:12.421729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f2273e85-eab6-4092-9c27-47e9324dc4e0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:12.430317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2273e85-eab6-4092-9c27-47e9324dc4e0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:12.430873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2273e85-eab6-4092-9c27-47e9324dc4e0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:12.433488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2273e85-eab6-4092-9c27-47e9324dc4e0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:12.433995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2273e85-eab6-4092-9c27-47e9324dc4e0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:12.564696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f2273e85-eab6-4092-9c27-47e9324dc4e0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:12.573550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f2273e85-eab6-4092-9c27-47e9324dc4e0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.162380 Dec 21 04:16:12.574142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 636/1309] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:12 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:12.634604 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3e8c0762-556b-4262-ba5a-d328a009e1b9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:12.635731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3e8c0762-556b-4262-ba5a-d328a009e1b9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:12.644368 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3e8c0762-556b-4262-ba5a-d328a009e1b9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:12.644872 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3e8c0762-556b-4262-ba5a-d328a009e1b9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:12.645698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3e8c0762-556b-4262-ba5a-d328a009e1b9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:12.646183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3e8c0762-556b-4262-ba5a-d328a009e1b9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:12.770748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3e8c0762-556b-4262-ba5a-d328a009e1b9 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 3831 microversion: 2.20 time: 0.145921 Dec 21 04:16:12.774935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 674/1310] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:12 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 3831 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:16:13.597227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4d65d5b1-c506-43d5-baa3-7393af3e1d8b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:13.598144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4d65d5b1-c506-43d5-baa3-7393af3e1d8b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:13.606655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d65d5b1-c506-43d5-baa3-7393af3e1d8b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:13.607202 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d65d5b1-c506-43d5-baa3-7393af3e1d8b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:13.608041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d65d5b1-c506-43d5-baa3-7393af3e1d8b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:13.608536 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4d65d5b1-c506-43d5-baa3-7393af3e1d8b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:13.746026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4d65d5b1-c506-43d5-baa3-7393af3e1d8b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:13.755714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4d65d5b1-c506-43d5-baa3-7393af3e1d8b tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.168065 Dec 21 04:16:13.755945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 637/1311] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:13 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:13.792767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-520ea615-a360-4b76-9632-1518249a6d47 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:13.793926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-520ea615-a360-4b76-9632-1518249a6d47 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:13.808138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-520ea615-a360-4b76-9632-1518249a6d47 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:13.808657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-520ea615-a360-4b76-9632-1518249a6d47 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:13.809510 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-520ea615-a360-4b76-9632-1518249a6d47 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:13.810011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-520ea615-a360-4b76-9632-1518249a6d47 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:13.831757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b25bd238-6fec-46a8-a550-f3b17820d454 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:13.832446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b25bd238-6fec-46a8-a550-f3b17820d454 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:13.841037 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b25bd238-6fec-46a8-a550-f3b17820d454 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:13.841679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b25bd238-6fec-46a8-a550-f3b17820d454 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:13.842623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b25bd238-6fec-46a8-a550-f3b17820d454 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:13.843242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b25bd238-6fec-46a8-a550-f3b17820d454 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:13.923797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b25bd238-6fec-46a8-a550-f3b17820d454 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Going to try to terminate instance {{(pid=94298) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:16:13.938705 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-520ea615-a360-4b76-9632-1518249a6d47 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 15025 microversion: 2.20 time: 0.158335 Dec 21 04:16:13.939527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 675/1312] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:13 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 15025 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:14.047966 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b25bd238-6fec-46a8-a550-f3b17820d454 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "DELETE /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 204 len: 0 microversion: 2.1 time: 0.225682 Dec 21 04:16:14.049027 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 638/1313] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:16:13 2020] DELETE /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:16:14.063753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bac48771-067e-44b8-9ba1-e9152a69344d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:14.064519 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bac48771-067e-44b8-9ba1-e9152a69344d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:14.073107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bac48771-067e-44b8-9ba1-e9152a69344d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:14.073605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bac48771-067e-44b8-9ba1-e9152a69344d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:14.074442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bac48771-067e-44b8-9ba1-e9152a69344d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:14.074953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bac48771-067e-44b8-9ba1-e9152a69344d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:14.299393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bac48771-067e-44b8-9ba1-e9152a69344d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:14.309251 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bac48771-067e-44b8-9ba1-e9152a69344d tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1673 microversion: 2.1 time: 0.255761 Dec 21 04:16:14.309867 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 676/1314] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:14 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1673 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:14.780860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0b9baeae-2fb3-4850-8108-a3f306089d3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:14.782160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0b9baeae-2fb3-4850-8108-a3f306089d3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:14.791679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0b9baeae-2fb3-4850-8108-a3f306089d3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:14.792383 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0b9baeae-2fb3-4850-8108-a3f306089d3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:14.793398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0b9baeae-2fb3-4850-8108-a3f306089d3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:14.794045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0b9baeae-2fb3-4850-8108-a3f306089d3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:14.796485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-d7c74978-31d4-468d-823f-d246bafbf1e5 req-aa4f221a-b190-45a1-b3b5-2f722b85bf86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01a14ee-b77e-4ed8-a7e7-deff054230f2", "name": "network-vif-unplugged", "status": "completed", "tag": "d85524f1-3da1-4673-85c8-375bc346d0de"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:14.805131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:14.805131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:16:14.815205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-d7c74978-31d4-468d-823f-d246bafbf1e5 req-aa4f221a-b190-45a1-b3b5-2f722b85bf86 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:14.815845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-d7c74978-31d4-468d-823f-d246bafbf1e5 req-aa4f221a-b190-45a1-b3b5-2f722b85bf86 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:14.835372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-d7c74978-31d4-468d-823f-d246bafbf1e5 req-aa4f221a-b190-45a1-b3b5-2f722b85bf86 service nova] Creating event network-vif-unplugged:d85524f1-3da1-4673-85c8-375bc346d0de for instance c01a14ee-b77e-4ed8-a7e7-deff054230f2 on hv-cinder-73306 Dec 21 04:16:14.841442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-d7c74978-31d4-468d-823f-d246bafbf1e5 req-aa4f221a-b190-45a1-b3b5-2f722b85bf86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059272 Dec 21 04:16:14.842302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 677/1315] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:16:14 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:16:14.947679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0b9baeae-2fb3-4850-8108-a3f306089d3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:14.956913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0b9baeae-2fb3-4850-8108-a3f306089d3e tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.186706 Dec 21 04:16:14.957675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 639/1316] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:14 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:14.962470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7e6c45b4-6e48-41c4-b5c9-98032103a0e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:14.963984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7e6c45b4-6e48-41c4-b5c9-98032103a0e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:14.974431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e6c45b4-6e48-41c4-b5c9-98032103a0e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:14.975218 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e6c45b4-6e48-41c4-b5c9-98032103a0e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:14.976256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e6c45b4-6e48-41c4-b5c9-98032103a0e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:14.976752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e6c45b4-6e48-41c4-b5c9-98032103a0e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:15.105142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7e6c45b4-6e48-41c4-b5c9-98032103a0e7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 18356 microversion: 2.20 time: 0.156631 Dec 21 04:16:15.108933 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 678/1317] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:14 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 18356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:15.333661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9acb4d96-bebf-4298-9ca2-b684ab510f5a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:15.334320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9acb4d96-bebf-4298-9ca2-b684ab510f5a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:15.342177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9acb4d96-bebf-4298-9ca2-b684ab510f5a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:15.342687 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9acb4d96-bebf-4298-9ca2-b684ab510f5a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:15.343589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9acb4d96-bebf-4298-9ca2-b684ab510f5a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:15.344075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9acb4d96-bebf-4298-9ca2-b684ab510f5a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:15.567740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9acb4d96-bebf-4298-9ca2-b684ab510f5a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:15.577031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9acb4d96-bebf-4298-9ca2-b684ab510f5a tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1673 microversion: 2.1 time: 0.252717 Dec 21 04:16:15.577624 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 640/1318] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:15 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1673 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:15.982239 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9fd62eb6-1445-4cf4-b0e4-22595019d322 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:15.983083 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9fd62eb6-1445-4cf4-b0e4-22595019d322 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:15.992603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9fd62eb6-1445-4cf4-b0e4-22595019d322 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:15.993120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9fd62eb6-1445-4cf4-b0e4-22595019d322 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:15.993967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9fd62eb6-1445-4cf4-b0e4-22595019d322 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:15.994466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9fd62eb6-1445-4cf4-b0e4-22595019d322 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:16.123130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-88be1b6c-20de-4232-967e-70053818d14e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:16.124188 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-88be1b6c-20de-4232-967e-70053818d14e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:16.132631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88be1b6c-20de-4232-967e-70053818d14e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:16.133144 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88be1b6c-20de-4232-967e-70053818d14e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:16.133264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-9fd62eb6-1445-4cf4-b0e4-22595019d322 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:16.133988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88be1b6c-20de-4232-967e-70053818d14e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:16.134482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88be1b6c-20de-4232-967e-70053818d14e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:16.142623 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9fd62eb6-1445-4cf4-b0e4-22595019d322 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.170347 Dec 21 04:16:16.143399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 679/1319] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:15 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:16.258341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-88be1b6c-20de-4232-967e-70053818d14e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 19539 microversion: 2.20 time: 0.145069 Dec 21 04:16:16.262281 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 641/1320] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:16 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 19539 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:16.602282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-95826f0b-0124-4da6-8148-74596b60e2d0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:16.602992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-95826f0b-0124-4da6-8148-74596b60e2d0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:16.611335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-95826f0b-0124-4da6-8148-74596b60e2d0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:16.611849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-95826f0b-0124-4da6-8148-74596b60e2d0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:16.612698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-95826f0b-0124-4da6-8148-74596b60e2d0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:16.613197 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-95826f0b-0124-4da6-8148-74596b60e2d0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:16.757052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-95826f0b-0124-4da6-8148-74596b60e2d0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:16.766033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-95826f0b-0124-4da6-8148-74596b60e2d0 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1605 microversion: 2.1 time: 0.174107 Dec 21 04:16:16.766813 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 680/1321] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:16 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1605 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:17.176889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-09a3d755-e975-4255-8726-7abd320e450d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:17.178790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-09a3d755-e975-4255-8726-7abd320e450d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:17.200565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09a3d755-e975-4255-8726-7abd320e450d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:17.201548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09a3d755-e975-4255-8726-7abd320e450d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:17.202249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-aa03914f-0c5a-4149-9dd8-22e021d2d213 req-57e6f6f0-d768-4246-bffc-706dbd1abeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01a14ee-b77e-4ed8-a7e7-deff054230f2", "name": "network-vif-deleted", "tag": "d85524f1-3da1-4673-85c8-375bc346d0de"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:17.203063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09a3d755-e975-4255-8726-7abd320e450d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:17.203818 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09a3d755-e975-4255-8726-7abd320e450d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:17.221374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:17.221374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:16:17.230281 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-aa03914f-0c5a-4149-9dd8-22e021d2d213 req-57e6f6f0-d768-4246-bffc-706dbd1abeb1 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:17.230844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-aa03914f-0c5a-4149-9dd8-22e021d2d213 req-57e6f6f0-d768-4246-bffc-706dbd1abeb1 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:17.259045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-aa03914f-0c5a-4149-9dd8-22e021d2d213 req-57e6f6f0-d768-4246-bffc-706dbd1abeb1 service nova] Creating event network-vif-deleted:d85524f1-3da1-4673-85c8-375bc346d0de for instance c01a14ee-b77e-4ed8-a7e7-deff054230f2 on hv-cinder-73306 Dec 21 04:16:17.265628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-aa03914f-0c5a-4149-9dd8-22e021d2d213 req-57e6f6f0-d768-4246-bffc-706dbd1abeb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072881 Dec 21 04:16:17.270067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 681/1322] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:16:17 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:16:17.285501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c0e06237-1c68-4c27-be4b-4380e5c34be7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:17.286687 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c0e06237-1c68-4c27-be4b-4380e5c34be7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:17.298862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c0e06237-1c68-4c27-be4b-4380e5c34be7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:17.299395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c0e06237-1c68-4c27-be4b-4380e5c34be7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:17.300255 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c0e06237-1c68-4c27-be4b-4380e5c34be7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:17.300738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c0e06237-1c68-4c27-be4b-4380e5c34be7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:17.403884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-09a3d755-e975-4255-8726-7abd320e450d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:17.413614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-09a3d755-e975-4255-8726-7abd320e450d tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.256665 Dec 21 04:16:17.414214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 642/1323] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:17 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:17.435971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c0e06237-1c68-4c27-be4b-4380e5c34be7 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 22716 microversion: 2.20 time: 0.163701 Dec 21 04:16:17.436658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 682/1324] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:17 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 22716 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:17.792729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7dc80f62-24de-4dc1-a61e-95ce6e65202c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:17.794486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7dc80f62-24de-4dc1-a61e-95ce6e65202c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:17.806189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7dc80f62-24de-4dc1-a61e-95ce6e65202c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:17.807015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7dc80f62-24de-4dc1-a61e-95ce6e65202c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:17.808686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7dc80f62-24de-4dc1-a61e-95ce6e65202c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:17.809510 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7dc80f62-24de-4dc1-a61e-95ce6e65202c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:17.894665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7dc80f62-24de-4dc1-a61e-95ce6e65202c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:17.895197 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7dc80f62-24de-4dc1-a61e-95ce6e65202c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:17.895709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-7dc80f62-24de-4dc1-a61e-95ce6e65202c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lazy-loading 'fault' on Instance uuid c01a14ee-b77e-4ed8-a7e7-deff054230f2 {{(pid=94298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:16:17.979174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7dc80f62-24de-4dc1-a61e-95ce6e65202c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc28a0b363024c9d97f3be0a04b1bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527547042444d469350a38850143d5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:17.987431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7dc80f62-24de-4dc1-a61e-95ce6e65202c tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 200 len: 1326 microversion: 2.1 time: 0.206563 Dec 21 04:16:17.991018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 643/1325] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:17 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 1326 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:18.437676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-733622fc-57ff-40b9-ace4-4e98d05e7ae0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:18.438446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-733622fc-57ff-40b9-ace4-4e98d05e7ae0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:18.447869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-733622fc-57ff-40b9-ace4-4e98d05e7ae0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:18.448599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-733622fc-57ff-40b9-ace4-4e98d05e7ae0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:18.449601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-733622fc-57ff-40b9-ace4-4e98d05e7ae0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:18.450249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-733622fc-57ff-40b9-ace4-4e98d05e7ae0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:18.453635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8e61d059-1488-4963-91e2-8669a8ff135e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:18.455091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8e61d059-1488-4963-91e2-8669a8ff135e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:18.465115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e61d059-1488-4963-91e2-8669a8ff135e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:18.465864 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e61d059-1488-4963-91e2-8669a8ff135e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:18.466920 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e61d059-1488-4963-91e2-8669a8ff135e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:18.467633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e61d059-1488-4963-91e2-8669a8ff135e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:18.586992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8e61d059-1488-4963-91e2-8669a8ff135e tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 23957 microversion: 2.20 time: 0.143480 Dec 21 04:16:18.587701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 644/1326] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:18 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 23957 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:18.590722 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-733622fc-57ff-40b9-ace4-4e98d05e7ae0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:18.599960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-733622fc-57ff-40b9-ace4-4e98d05e7ae0 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.171980 Dec 21 04:16:18.600549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 683/1327] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:18 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:19.014461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-590ccc66-7929-43ec-85a0-51d699dc8a13 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:19.015353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-590ccc66-7929-43ec-85a0-51d699dc8a13 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:19.024165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-590ccc66-7929-43ec-85a0-51d699dc8a13 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:19.024683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-590ccc66-7929-43ec-85a0-51d699dc8a13 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:19.025528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-590ccc66-7929-43ec-85a0-51d699dc8a13 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:19.026047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-590ccc66-7929-43ec-85a0-51d699dc8a13 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:19.079020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-590ccc66-7929-43ec-85a0-51d699dc8a13 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] HTTP exception thrown: Instance c01a14ee-b77e-4ed8-a7e7-deff054230f2 could not be found. Dec 21 04:16:19.079691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-590ccc66-7929-43ec-85a0-51d699dc8a13 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Returning 404 to user: Instance c01a14ee-b77e-4ed8-a7e7-deff054230f2 could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:16:19.080588 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-590ccc66-7929-43ec-85a0-51d699dc8a13 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 404 len: 111 microversion: 2.1 time: 0.077102 Dec 21 04:16:19.081198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 645/1328] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:19 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:16:19.095465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dd43f070-0b7c-4367-82b6-d7bfd10ce4b4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '.version_select at 0x7f2bb85a9488>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:19.121212 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dd43f070-0b7c-4367-82b6-d7bfd10ce4b4 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951984485" status: 202 len: 0 microversion: 2.1 time: 0.034849 Dec 21 04:16:19.121826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 684/1329] 10.222.0.16 () {58 vars in 1211 bytes} [Mon Dec 21 04:16:19 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951984485 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:19.605533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a84e1a21-a84a-458a-9f19-16fd5de5b9bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:19.606516 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a84e1a21-a84a-458a-9f19-16fd5de5b9bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:19.614439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a84e1a21-a84a-458a-9f19-16fd5de5b9bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:19.614981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a84e1a21-a84a-458a-9f19-16fd5de5b9bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:19.616279 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a84e1a21-a84a-458a-9f19-16fd5de5b9bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:19.617036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a84e1a21-a84a-458a-9f19-16fd5de5b9bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:19.622837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d1b0e09f-8653-4074-87d0-bf2eb3146b30 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:19.623546 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d1b0e09f-8653-4074-87d0-bf2eb3146b30 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:19.632194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d1b0e09f-8653-4074-87d0-bf2eb3146b30 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:19.632710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d1b0e09f-8653-4074-87d0-bf2eb3146b30 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:19.633609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d1b0e09f-8653-4074-87d0-bf2eb3146b30 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:19.634084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d1b0e09f-8653-4074-87d0-bf2eb3146b30 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:19.736459 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a84e1a21-a84a-458a-9f19-16fd5de5b9bd tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 25868 microversion: 2.20 time: 0.140835 Dec 21 04:16:19.737171 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 646/1330] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:19 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 25868 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:19.892915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d1b0e09f-8653-4074-87d0-bf2eb3146b30 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:19.902951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d1b0e09f-8653-4074-87d0-bf2eb3146b30 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.289855 Dec 21 04:16:19.903994 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 685/1331] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:19 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:20.754980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e16ad805-7b22-49f0-8383-8f812d5abe6c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:20.756193 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e16ad805-7b22-49f0-8383-8f812d5abe6c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:20.764785 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e16ad805-7b22-49f0-8383-8f812d5abe6c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:20.765291 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e16ad805-7b22-49f0-8383-8f812d5abe6c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:20.766118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e16ad805-7b22-49f0-8383-8f812d5abe6c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:20.766614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e16ad805-7b22-49f0-8383-8f812d5abe6c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:20.891724 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e16ad805-7b22-49f0-8383-8f812d5abe6c tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 27149 microversion: 2.20 time: 0.146167 Dec 21 04:16:20.892401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 647/1332] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:20 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 27149 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:20.925992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-80be92c4-3dd6-4cba-ba99-af9449bb7b87 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:20.926658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-80be92c4-3dd6-4cba-ba99-af9449bb7b87 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:20.935320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-80be92c4-3dd6-4cba-ba99-af9449bb7b87 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:20.935769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-80be92c4-3dd6-4cba-ba99-af9449bb7b87 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:20.936597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-80be92c4-3dd6-4cba-ba99-af9449bb7b87 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:20.937090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-80be92c4-3dd6-4cba-ba99-af9449bb7b87 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:21.072520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-80be92c4-3dd6-4cba-ba99-af9449bb7b87 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:21.081267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-80be92c4-3dd6-4cba-ba99-af9449bb7b87 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.164329 Dec 21 04:16:21.081858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 686/1333] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:20 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:21.909986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c885a5ad-1ef6-4dab-8f27-d1bd4555e048 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:21.911187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c885a5ad-1ef6-4dab-8f27-d1bd4555e048 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:21.919791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c885a5ad-1ef6-4dab-8f27-d1bd4555e048 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:21.920312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c885a5ad-1ef6-4dab-8f27-d1bd4555e048 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:21.921146 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c885a5ad-1ef6-4dab-8f27-d1bd4555e048 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:21.921643 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c885a5ad-1ef6-4dab-8f27-d1bd4555e048 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:22.041902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c885a5ad-1ef6-4dab-8f27-d1bd4555e048 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 27887 microversion: 2.20 time: 0.141425 Dec 21 04:16:22.042505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 648/1334] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:21 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 27887 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:22.105044 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e74ab6ca-9e28-4470-b2fc-42d580b38ded tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:22.105721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e74ab6ca-9e28-4470-b2fc-42d580b38ded tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:22.114052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e74ab6ca-9e28-4470-b2fc-42d580b38ded tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:22.114569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e74ab6ca-9e28-4470-b2fc-42d580b38ded tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:22.115928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e74ab6ca-9e28-4470-b2fc-42d580b38ded tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:22.116702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e74ab6ca-9e28-4470-b2fc-42d580b38ded tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:22.250524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e74ab6ca-9e28-4470-b2fc-42d580b38ded tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:22.259964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e74ab6ca-9e28-4470-b2fc-42d580b38ded tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.164068 Dec 21 04:16:22.260557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 687/1335] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:22 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:22.439489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-27fb0ca7-9551-4c8b-aa0b-afcd884c79c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:22.440137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-27fb0ca7-9551-4c8b-aa0b-afcd884c79c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:22.449200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-27fb0ca7-9551-4c8b-aa0b-afcd884c79c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:22.449713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-27fb0ca7-9551-4c8b-aa0b-afcd884c79c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:22.450556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-27fb0ca7-9551-4c8b-aa0b-afcd884c79c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:22.451085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-27fb0ca7-9551-4c8b-aa0b-afcd884c79c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:22.763118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-27fb0ca7-9551-4c8b-aa0b-afcd884c79c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bde3060-362c-4e96-869a-ad83fa72956e) Dec 21 04:16:22.763812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-27fb0ca7-9551-4c8b-aa0b-afcd884c79c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bde3060-362c-4e96-869a-ad83fa72956e) {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:16:22.764732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-27fb0ca7-9551-4c8b-aa0b-afcd884c79c0 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "DELETE /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/os-volume_attachments/1e143391-15c7-44a4-a604-43b10f13945e" status: 400 len: 269 microversion: 2.1 time: 0.334976 Dec 21 04:16:22.765384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 649/1336] 10.222.0.16 () {58 vars in 1406 bytes} [Mon Dec 21 04:16:22 2020] DELETE /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98/os-volume_attachments/1e143391-15c7-44a4-a604-43b10f13945e => generated 269 bytes in 337 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 21 04:16:23.059659 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bce84ef6-06d7-450a-9057-fbe7fc566c15 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:23.060698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bce84ef6-06d7-450a-9057-fbe7fc566c15 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:23.069327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bce84ef6-06d7-450a-9057-fbe7fc566c15 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:23.069825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bce84ef6-06d7-450a-9057-fbe7fc566c15 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:23.070646 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bce84ef6-06d7-450a-9057-fbe7fc566c15 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:23.071195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bce84ef6-06d7-450a-9057-fbe7fc566c15 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:23.191581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bce84ef6-06d7-450a-9057-fbe7fc566c15 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 28164 microversion: 2.20 time: 0.140753 Dec 21 04:16:23.192281 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 688/1337] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:23 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 28164 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:23.283489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e45b5f05-e231-4ad7-acab-18416afb1c48 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:23.284153 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e45b5f05-e231-4ad7-acab-18416afb1c48 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:23.295873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e45b5f05-e231-4ad7-acab-18416afb1c48 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:23.296374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e45b5f05-e231-4ad7-acab-18416afb1c48 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:23.297205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e45b5f05-e231-4ad7-acab-18416afb1c48 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:23.297701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e45b5f05-e231-4ad7-acab-18416afb1c48 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:23.427489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e45b5f05-e231-4ad7-acab-18416afb1c48 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:23.436937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e45b5f05-e231-4ad7-acab-18416afb1c48 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.162524 Dec 21 04:16:23.437526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 650/1338] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:23 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:24.211410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c61f14a1-c240-41c0-b662-0c0edea0d1c0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:24.212596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c61f14a1-c240-41c0-b662-0c0edea0d1c0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:24.221355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c61f14a1-c240-41c0-b662-0c0edea0d1c0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:24.221863 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c61f14a1-c240-41c0-b662-0c0edea0d1c0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:24.222696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c61f14a1-c240-41c0-b662-0c0edea0d1c0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:24.223216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c61f14a1-c240-41c0-b662-0c0edea0d1c0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:24.337059 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c61f14a1-c240-41c0-b662-0c0edea0d1c0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 28164 microversion: 2.20 time: 0.135761 Dec 21 04:16:24.338678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 689/1339] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:24 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 28164 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:24.461189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b634564f-1b51-4cce-b605-2adb34e7f2f9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:24.461959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b634564f-1b51-4cce-b605-2adb34e7f2f9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:24.470419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b634564f-1b51-4cce-b605-2adb34e7f2f9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:24.470942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b634564f-1b51-4cce-b605-2adb34e7f2f9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:24.471820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b634564f-1b51-4cce-b605-2adb34e7f2f9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:24.472311 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b634564f-1b51-4cce-b605-2adb34e7f2f9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:24.605102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b634564f-1b51-4cce-b605-2adb34e7f2f9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:24.613923 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b634564f-1b51-4cce-b605-2adb34e7f2f9 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1220 microversion: 2.1 time: 0.162549 Dec 21 04:16:24.614528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 651/1340] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:24 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1220 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:25.355992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-85450a6b-21c2-47bd-9e45-d4af9a08952d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:25.357129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-85450a6b-21c2-47bd-9e45-d4af9a08952d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:25.367125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-85450a6b-21c2-47bd-9e45-d4af9a08952d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:25.367641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-85450a6b-21c2-47bd-9e45-d4af9a08952d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:25.368481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-85450a6b-21c2-47bd-9e45-d4af9a08952d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:25.368976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-85450a6b-21c2-47bd-9e45-d4af9a08952d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:25.493917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-85450a6b-21c2-47bd-9e45-d4af9a08952d tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 28454 microversion: 2.20 time: 0.147957 Dec 21 04:16:25.495300 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 690/1341] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:25 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 28454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:25.637884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e947c6aa-2a86-4efe-b812-16ddbfc7a02a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:25.638772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e947c6aa-2a86-4efe-b812-16ddbfc7a02a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:25.647254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e947c6aa-2a86-4efe-b812-16ddbfc7a02a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:25.647760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e947c6aa-2a86-4efe-b812-16ddbfc7a02a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:25.648595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e947c6aa-2a86-4efe-b812-16ddbfc7a02a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:25.649088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e947c6aa-2a86-4efe-b812-16ddbfc7a02a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:25.727079 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e947c6aa-2a86-4efe-b812-16ddbfc7a02a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:25.727583 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e947c6aa-2a86-4efe-b812-16ddbfc7a02a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:25.728085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-e947c6aa-2a86-4efe-b812-16ddbfc7a02a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lazy-loading 'fault' on Instance uuid 56c04726-583d-4c58-82b1-5baccee7c4a7 {{(pid=94298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:16:25.794976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e947c6aa-2a86-4efe-b812-16ddbfc7a02a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ff84deff8a4f01911a9cec1145b5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07ec805977d456b9447a634af514cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:16:25.803232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e947c6aa-2a86-4efe-b812-16ddbfc7a02a tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 200 len: 1268 microversion: 2.1 time: 0.174685 Dec 21 04:16:25.803836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 652/1342] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:25 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:16:26.512856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cf1dd8ce-6f5c-4378-8004-18702fb526cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:26.513993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cf1dd8ce-6f5c-4378-8004-18702fb526cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:26.522540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cf1dd8ce-6f5c-4378-8004-18702fb526cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:26.523088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cf1dd8ce-6f5c-4378-8004-18702fb526cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:26.523924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cf1dd8ce-6f5c-4378-8004-18702fb526cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:26.524409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cf1dd8ce-6f5c-4378-8004-18702fb526cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:26.647156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cf1dd8ce-6f5c-4378-8004-18702fb526cc tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 28622 microversion: 2.20 time: 0.144038 Dec 21 04:16:26.647855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 691/1343] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:26 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 28622 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:26.826601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-67208938-83ef-4554-9c20-85693606f721 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:26.827296 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-67208938-83ef-4554-9c20-85693606f721 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] [instance: 56c04726-583d-4c58-82b1-5baccee7c4a7] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:26.835630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-67208938-83ef-4554-9c20-85693606f721 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:26.836138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-67208938-83ef-4554-9c20-85693606f721 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:26.836962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-67208938-83ef-4554-9c20-85693606f721 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:26.837453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-67208938-83ef-4554-9c20-85693606f721 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:26.893721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-67208938-83ef-4554-9c20-85693606f721 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] HTTP exception thrown: Instance 56c04726-583d-4c58-82b1-5baccee7c4a7 could not be found. Dec 21 04:16:26.894373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-67208938-83ef-4554-9c20-85693606f721 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Returning 404 to user: Instance 56c04726-583d-4c58-82b1-5baccee7c4a7 could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:16:26.895288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-67208938-83ef-4554-9c20-85693606f721 tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7" status: 404 len: 111 microversion: 2.1 time: 0.077958 Dec 21 04:16:26.895883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 653/1344] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:16:26 2020] GET /compute/v2.1/servers/56c04726-583d-4c58-82b1-5baccee7c4a7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:16:26.910641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-216f9483-8b77-4f19-aa2a-d1a272091acf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '.version_select at 0x7f2bb83e1f28>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:27.156547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-216f9483-8b77-4f19-aa2a-d1a272091acf tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c69f3a10-da00-4297-95de-3f1efe38de68" status: 202 len: 0 microversion: 2.1 time: 0.255565 Dec 21 04:16:27.157203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 692/1345] 10.222.0.16 () {58 vars in 1262 bytes} [Mon Dec 21 04:16:26 2020] DELETE /compute/v2.1/os-security-groups/c69f3a10-da00-4297-95de-3f1efe38de68 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:27.171946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2757947c-ec95-43cc-8938-dd258bce69db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] Calling method '.version_select at 0x7f2bb8744c80>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:27.193471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2757947c-ec95-43cc-8938-dd258bce69db tempest-TestShelveInstance-1066925137 tempest-TestShelveInstance-1066925137] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2008430900" status: 202 len: 0 microversion: 2.1 time: 0.031482 Dec 21 04:16:27.194082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 654/1346] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Dec 21 04:16:27 2020] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2008430900 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:27.666702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fb44ede4-eb74-4bb9-9499-65b3c21fafaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:27.666702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fb44ede4-eb74-4bb9-9499-65b3c21fafaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:27.678780 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fb44ede4-eb74-4bb9-9499-65b3c21fafaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:27.679417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fb44ede4-eb74-4bb9-9499-65b3c21fafaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:27.680481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fb44ede4-eb74-4bb9-9499-65b3c21fafaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:27.681073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fb44ede4-eb74-4bb9-9499-65b3c21fafaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:27.793596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fb44ede4-eb74-4bb9-9499-65b3c21fafaa tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 28622 microversion: 2.20 time: 0.138043 Dec 21 04:16:27.797828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 693/1347] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:27 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 28622 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:28.811720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-16bf2cd6-4430-44bf-976e-61ac4ab61133 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:28.812477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-16bf2cd6-4430-44bf-976e-61ac4ab61133 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:28.821055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16bf2cd6-4430-44bf-976e-61ac4ab61133 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:28.821758 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16bf2cd6-4430-44bf-976e-61ac4ab61133 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:28.822379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16bf2cd6-4430-44bf-976e-61ac4ab61133 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:28.822871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16bf2cd6-4430-44bf-976e-61ac4ab61133 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:28.926030 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-16bf2cd6-4430-44bf-976e-61ac4ab61133 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 28622 microversion: 2.20 time: 0.123707 Dec 21 04:16:28.930136 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 655/1348] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:28 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 28622 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 21 04:16:29.953205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-55d8d77c-b7c3-444f-a6a5-983c2fd18914 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:29.954367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-55d8d77c-b7c3-444f-a6a5-983c2fd18914 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:29.963052 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55d8d77c-b7c3-444f-a6a5-983c2fd18914 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:29.963569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55d8d77c-b7c3-444f-a6a5-983c2fd18914 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:29.964418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55d8d77c-b7c3-444f-a6a5-983c2fd18914 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:29.964918 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55d8d77c-b7c3-444f-a6a5-983c2fd18914 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:30.086510 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-55d8d77c-b7c3-444f-a6a5-983c2fd18914 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 29939 microversion: 2.20 time: 0.151928 Dec 21 04:16:30.088495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 694/1349] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:29 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 29939 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:31.104414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a091a7b0-d382-4a10-a066-21a3131548ad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:31.105737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a091a7b0-d382-4a10-a066-21a3131548ad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:31.114564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a091a7b0-d382-4a10-a066-21a3131548ad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:31.115747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a091a7b0-d382-4a10-a066-21a3131548ad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:31.116972 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a091a7b0-d382-4a10-a066-21a3131548ad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:31.117572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a091a7b0-d382-4a10-a066-21a3131548ad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:31.244518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a091a7b0-d382-4a10-a066-21a3131548ad tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 32164 microversion: 2.20 time: 0.149892 Dec 21 04:16:31.245343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 656/1350] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:31 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 32164 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:32.270481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-572f5507-dec3-4637-a274-d9b603084e42 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:32.272910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-572f5507-dec3-4637-a274-d9b603084e42 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:32.281711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-572f5507-dec3-4637-a274-d9b603084e42 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:32.282319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-572f5507-dec3-4637-a274-d9b603084e42 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:32.283282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-572f5507-dec3-4637-a274-d9b603084e42 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:32.283751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-572f5507-dec3-4637-a274-d9b603084e42 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:32.403360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-572f5507-dec3-4637-a274-d9b603084e42 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 33509 microversion: 2.20 time: 0.142471 Dec 21 04:16:32.407720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 695/1351] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:32 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 33509 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:33.422170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b1b7f057-c3e6-425e-b4df-beada25f53af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:33.423394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b1b7f057-c3e6-425e-b4df-beada25f53af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:33.432308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1b7f057-c3e6-425e-b4df-beada25f53af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:33.432814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1b7f057-c3e6-425e-b4df-beada25f53af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:33.433649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1b7f057-c3e6-425e-b4df-beada25f53af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:33.434140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b1b7f057-c3e6-425e-b4df-beada25f53af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:33.560351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b1b7f057-c3e6-425e-b4df-beada25f53af tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 34722 microversion: 2.20 time: 0.148298 Dec 21 04:16:33.561226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 657/1352] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:33 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 34722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:34.579407 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-44231d2a-57d8-4a65-bebd-cb901806bff4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:34.580551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-44231d2a-57d8-4a65-bebd-cb901806bff4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:34.589234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44231d2a-57d8-4a65-bebd-cb901806bff4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:34.589653 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44231d2a-57d8-4a65-bebd-cb901806bff4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:34.590494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44231d2a-57d8-4a65-bebd-cb901806bff4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:34.591002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-44231d2a-57d8-4a65-bebd-cb901806bff4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:34.715943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-44231d2a-57d8-4a65-bebd-cb901806bff4 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 36117 microversion: 2.20 time: 0.146095 Dec 21 04:16:34.717063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 696/1353] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:34 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 36117 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:35.734978 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5a82b542-d9b3-447c-9c61-64033d984198 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:35.736136 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5a82b542-d9b3-447c-9c61-64033d984198 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:35.745808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a82b542-d9b3-447c-9c61-64033d984198 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:35.746320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a82b542-d9b3-447c-9c61-64033d984198 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:35.747187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a82b542-d9b3-447c-9c61-64033d984198 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:35.747690 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5a82b542-d9b3-447c-9c61-64033d984198 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:35.866620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5a82b542-d9b3-447c-9c61-64033d984198 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 37884 microversion: 2.20 time: 0.140082 Dec 21 04:16:35.867640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 658/1354] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:35 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 37884 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:36.886142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-51a8cb37-9250-4783-8a9b-2990fc9d5aa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:36.887312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-51a8cb37-9250-4783-8a9b-2990fc9d5aa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:36.896446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-51a8cb37-9250-4783-8a9b-2990fc9d5aa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:36.896996 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-51a8cb37-9250-4783-8a9b-2990fc9d5aa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:36.897841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-51a8cb37-9250-4783-8a9b-2990fc9d5aa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:36.898343 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-51a8cb37-9250-4783-8a9b-2990fc9d5aa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:37.018087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-51a8cb37-9250-4783-8a9b-2990fc9d5aa0 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 38177 microversion: 2.20 time: 0.142011 Dec 21 04:16:37.019100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 697/1355] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:36 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 38177 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 21 04:16:38.039969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-751b4f7a-db3d-4b13-a89e-f35306b67256 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:38.041838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-751b4f7a-db3d-4b13-a89e-f35306b67256 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:38.052223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-751b4f7a-db3d-4b13-a89e-f35306b67256 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:38.053549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-751b4f7a-db3d-4b13-a89e-f35306b67256 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:38.054635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-751b4f7a-db3d-4b13-a89e-f35306b67256 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:38.055869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-751b4f7a-db3d-4b13-a89e-f35306b67256 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:38.167355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-751b4f7a-db3d-4b13-a89e-f35306b67256 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 38177 microversion: 2.20 time: 0.137557 Dec 21 04:16:38.168323 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 659/1356] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:38 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 38177 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:39.186169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-df870444-49d7-4c2d-8461-b74617a6c6b2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:39.187473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-df870444-49d7-4c2d-8461-b74617a6c6b2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:39.201854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df870444-49d7-4c2d-8461-b74617a6c6b2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:39.201854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df870444-49d7-4c2d-8461-b74617a6c6b2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:39.201854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df870444-49d7-4c2d-8461-b74617a6c6b2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:39.201854 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-df870444-49d7-4c2d-8461-b74617a6c6b2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:39.307230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-df870444-49d7-4c2d-8461-b74617a6c6b2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 38177 microversion: 2.20 time: 0.130747 Dec 21 04:16:39.311648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 698/1357] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:39 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 38177 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:40.326189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c9295b48-0699-4628-8780-e9b107797170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:16:40.327397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c9295b48-0699-4628-8780-e9b107797170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:40.336574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c9295b48-0699-4628-8780-e9b107797170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:40.337081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c9295b48-0699-4628-8780-e9b107797170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:40.337913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c9295b48-0699-4628-8780-e9b107797170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:40.338405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c9295b48-0699-4628-8780-e9b107797170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:40.463256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c9295b48-0699-4628-8780-e9b107797170 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action" status: 200 len: 38320 microversion: 2.20 time: 0.146827 Dec 21 04:16:40.463942 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 660/1358] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Dec 21 04:16:40 2020] POST /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/action => generated 38320 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:16:40.480960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4896efac-78b4-4211-bfd4-fbb08b3da9d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:16:40.481615 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4896efac-78b4-4211-bfd4-fbb08b3da9d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:16:40.490382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4896efac-78b4-4211-bfd4-fbb08b3da9d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:40.490893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4896efac-78b4-4211-bfd4-fbb08b3da9d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:40.492056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4896efac-78b4-4211-bfd4-fbb08b3da9d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:16:40.492560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4896efac-78b4-4211-bfd4-fbb08b3da9d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:16:40.561945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4896efac-78b4-4211-bfd4-fbb08b3da9d2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/ips" status: 200 len: 151 microversion: 2.20 time: 0.091063 Dec 21 04:16:40.562572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 699/1359] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Dec 21 04:16:40 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 21 04:17:06.097240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:17:06.097748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:17:06 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:18:47.233591 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:18:47.234060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:18:47 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:19:06.033169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:19:06.033685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:19:06 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:19:06.456044 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:19:06.456341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:19:06 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:19:14.684883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:19:14.685350 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:19:14 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:20:23.765312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27fe5106-18ea-44c6-8644-655b910d6119] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 21 04:20:23.774261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-969c7a4e-55bb-47ee-b75d-7ce80dd9c3fa tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:23.774907 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-969c7a4e-55bb-47ee-b75d-7ce80dd9c3fa tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:23.783270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-969c7a4e-55bb-47ee-b75d-7ce80dd9c3fa tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:23.783776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-969c7a4e-55bb-47ee-b75d-7ce80dd9c3fa tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:23.784607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-969c7a4e-55bb-47ee-b75d-7ce80dd9c3fa tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:23.785099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-969c7a4e-55bb-47ee-b75d-7ce80dd9c3fa tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:23.857701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-969c7a4e-55bb-47ee-b75d-7ce80dd9c3fa tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Going to try to terminate instance {{(pid=94298) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:20:23.974759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-969c7a4e-55bb-47ee-b75d-7ce80dd9c3fa tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "DELETE /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 204 len: 0 microversion: 2.1 time: 0.210112 Dec 21 04:20:23.975497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 661/1360] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:20:23 2020] DELETE /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:20:23.990351 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a4068104-e77c-4f78-88ef-ba98779655a3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:23.991206 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a4068104-e77c-4f78-88ef-ba98779655a3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:23.995205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dca63194-cb64-420f-b69a-f6c254fed282] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 21 04:20:24.000751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4068104-e77c-4f78-88ef-ba98779655a3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:24.001302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4068104-e77c-4f78-88ef-ba98779655a3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:24.002084 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4068104-e77c-4f78-88ef-ba98779655a3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:24.002570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4068104-e77c-4f78-88ef-ba98779655a3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:24.420102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a4068104-e77c-4f78-88ef-ba98779655a3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:24.429627 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a4068104-e77c-4f78-88ef-ba98779655a3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1560 microversion: 2.1 time: 0.449505 Dec 21 04:20:24.430224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 700/1361] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:23 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1560 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:24.727301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-83b41896-2565-4809-b5bc-57a88b223a76 req-e38ca069-83e9-4d7f-aa90-0342cdba8fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63061bb7-38e7-4c2a-ac1d-eb8752fa584e", "name": "network-vif-unplugged", "status": "completed", "tag": "a4d70010-d5c7-45a0-a55b-d30d1f2df8be"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:20:24.734475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:24.734475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:20:24.744055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-83b41896-2565-4809-b5bc-57a88b223a76 req-e38ca069-83e9-4d7f-aa90-0342cdba8fa0 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:24.744561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-83b41896-2565-4809-b5bc-57a88b223a76 req-e38ca069-83e9-4d7f-aa90-0342cdba8fa0 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:24.763283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-83b41896-2565-4809-b5bc-57a88b223a76 req-e38ca069-83e9-4d7f-aa90-0342cdba8fa0 service nova] Creating event network-vif-unplugged:a4d70010-d5c7-45a0-a55b-d30d1f2df8be for instance 63061bb7-38e7-4c2a-ac1d-eb8752fa584e on hv-cinder-73306 Dec 21 04:20:24.779692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-83b41896-2565-4809-b5bc-57a88b223a76 req-e38ca069-83e9-4d7f-aa90-0342cdba8fa0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061944 Dec 21 04:20:24.780901 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 662/1362] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:20:24 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:20:25.454594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dffd4bdd-c088-4ebe-b031-cbd350a6043e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:25.455506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dffd4bdd-c088-4ebe-b031-cbd350a6043e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:25.474943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dffd4bdd-c088-4ebe-b031-cbd350a6043e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:25.475464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dffd4bdd-c088-4ebe-b031-cbd350a6043e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:25.476301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dffd4bdd-c088-4ebe-b031-cbd350a6043e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:25.476793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dffd4bdd-c088-4ebe-b031-cbd350a6043e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:25.540333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] [dca63194-cb64-420f-b69a-f6c254fed282] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60274. Dec 21 04:20:25.576616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] [27fe5106-18ea-44c6-8644-655b910d6119] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60262. Dec 21 04:20:25.616065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dffd4bdd-c088-4ebe-b031-cbd350a6043e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:25.628240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dffd4bdd-c088-4ebe-b031-cbd350a6043e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1518 microversion: 2.1 time: 0.183428 Dec 21 04:20:25.628910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 701/1363] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:25 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1518 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:25.678517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-d8a1d699-7395-4db9-8c60-09c985e72910 req-233feb7f-2056-4145-88ea-225b31819b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63061bb7-38e7-4c2a-ac1d-eb8752fa584e", "name": "network-vif-deleted", "tag": "a4d70010-d5c7-45a0-a55b-d30d1f2df8be"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:20:25.685246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:25.685246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:20:25.694666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-d8a1d699-7395-4db9-8c60-09c985e72910 req-233feb7f-2056-4145-88ea-225b31819b79 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:25.695328 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-d8a1d699-7395-4db9-8c60-09c985e72910 req-233feb7f-2056-4145-88ea-225b31819b79 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:25.713197 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-d8a1d699-7395-4db9-8c60-09c985e72910 req-233feb7f-2056-4145-88ea-225b31819b79 service nova] Creating event network-vif-deleted:a4d70010-d5c7-45a0-a55b-d30d1f2df8be for instance 63061bb7-38e7-4c2a-ac1d-eb8752fa584e on hv-cinder-73306 Dec 21 04:20:25.717874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-d8a1d699-7395-4db9-8c60-09c985e72910 req-233feb7f-2056-4145-88ea-225b31819b79 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155085 Dec 21 04:20:25.718533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 663/1364] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:20:25 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:20:26.115439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:20:26.116054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:20:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:20:26.652191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-43ea6f58-0b5d-4a09-9f61-a19dc8a1b42a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:26.652851 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-43ea6f58-0b5d-4a09-9f61-a19dc8a1b42a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:26.660686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-43ea6f58-0b5d-4a09-9f61-a19dc8a1b42a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:26.661681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-43ea6f58-0b5d-4a09-9f61-a19dc8a1b42a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:26.662494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-43ea6f58-0b5d-4a09-9f61-a19dc8a1b42a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:26.663006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-43ea6f58-0b5d-4a09-9f61-a19dc8a1b42a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:26.799701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-43ea6f58-0b5d-4a09-9f61-a19dc8a1b42a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:26.809544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-43ea6f58-0b5d-4a09-9f61-a19dc8a1b42a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.166713 Dec 21 04:20:26.810137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 702/1365] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:26 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:27.833984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ca5365ad-bc4f-4821-a238-00409219893e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:27.834750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ca5365ad-bc4f-4821-a238-00409219893e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:27.842834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca5365ad-bc4f-4821-a238-00409219893e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:27.843388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca5365ad-bc4f-4821-a238-00409219893e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:27.844221 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca5365ad-bc4f-4821-a238-00409219893e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:27.844720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ca5365ad-bc4f-4821-a238-00409219893e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:28.067950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ca5365ad-bc4f-4821-a238-00409219893e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:28.077217 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ca5365ad-bc4f-4821-a238-00409219893e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.253434 Dec 21 04:20:28.077809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 664/1366] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:27 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:29.100273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d4fc7ace-f4b0-4c77-bcb8-44fddde556ab tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:29.101031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d4fc7ace-f4b0-4c77-bcb8-44fddde556ab tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:29.109103 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4fc7ace-f4b0-4c77-bcb8-44fddde556ab tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:29.109610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4fc7ace-f4b0-4c77-bcb8-44fddde556ab tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:29.110440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4fc7ace-f4b0-4c77-bcb8-44fddde556ab tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:29.110945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d4fc7ace-f4b0-4c77-bcb8-44fddde556ab tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:29.374672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d4fc7ace-f4b0-4c77-bcb8-44fddde556ab tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:29.384760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d4fc7ace-f4b0-4c77-bcb8-44fddde556ab tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.293634 Dec 21 04:20:29.385336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 703/1367] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:29 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:30.407651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d294838c-9a73-4de1-b2a6-a45a08d6b503 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:30.408321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d294838c-9a73-4de1-b2a6-a45a08d6b503 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:30.416763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d294838c-9a73-4de1-b2a6-a45a08d6b503 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:30.417272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d294838c-9a73-4de1-b2a6-a45a08d6b503 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:30.418108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d294838c-9a73-4de1-b2a6-a45a08d6b503 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:30.418599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d294838c-9a73-4de1-b2a6-a45a08d6b503 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:30.553912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d294838c-9a73-4de1-b2a6-a45a08d6b503 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:30.563412 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d294838c-9a73-4de1-b2a6-a45a08d6b503 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.165023 Dec 21 04:20:30.564006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 665/1368] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:30 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:31.587468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-12107184-e7ef-470c-ba29-b800e8820622 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:31.588138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-12107184-e7ef-470c-ba29-b800e8820622 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:31.595945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-12107184-e7ef-470c-ba29-b800e8820622 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:31.596447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-12107184-e7ef-470c-ba29-b800e8820622 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:31.597271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-12107184-e7ef-470c-ba29-b800e8820622 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:31.597758 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-12107184-e7ef-470c-ba29-b800e8820622 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:31.728423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-12107184-e7ef-470c-ba29-b800e8820622 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:31.737991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-12107184-e7ef-470c-ba29-b800e8820622 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.160054 Dec 21 04:20:31.738679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 704/1369] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:31 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:32.762110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-58dac619-9930-4268-8992-84826bba443c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:32.762774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-58dac619-9930-4268-8992-84826bba443c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:32.770597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58dac619-9930-4268-8992-84826bba443c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:32.771133 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58dac619-9930-4268-8992-84826bba443c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:32.771966 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58dac619-9930-4268-8992-84826bba443c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:32.772452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58dac619-9930-4268-8992-84826bba443c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:32.902435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-58dac619-9930-4268-8992-84826bba443c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:32.912374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-58dac619-9930-4268-8992-84826bba443c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.159461 Dec 21 04:20:32.912960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 666/1370] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:32 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:33.936463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c3af4e88-74c9-45a8-bd3e-51e294f34c8d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:33.938077 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c3af4e88-74c9-45a8-bd3e-51e294f34c8d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:33.948054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c3af4e88-74c9-45a8-bd3e-51e294f34c8d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:33.948557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c3af4e88-74c9-45a8-bd3e-51e294f34c8d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:33.949404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c3af4e88-74c9-45a8-bd3e-51e294f34c8d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:33.949896 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c3af4e88-74c9-45a8-bd3e-51e294f34c8d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:34.088825 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c3af4e88-74c9-45a8-bd3e-51e294f34c8d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:34.098719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c3af4e88-74c9-45a8-bd3e-51e294f34c8d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.172448 Dec 21 04:20:34.099434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 705/1371] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:33 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:35.122935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2fca17b0-84d0-4eb5-81ce-e569bc849af8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:35.123780 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2fca17b0-84d0-4eb5-81ce-e569bc849af8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:35.132379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2fca17b0-84d0-4eb5-81ce-e569bc849af8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:35.133257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2fca17b0-84d0-4eb5-81ce-e569bc849af8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:35.134102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2fca17b0-84d0-4eb5-81ce-e569bc849af8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:35.134592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2fca17b0-84d0-4eb5-81ce-e569bc849af8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:35.273579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2fca17b0-84d0-4eb5-81ce-e569bc849af8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:35.282874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2fca17b0-84d0-4eb5-81ce-e569bc849af8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.169908 Dec 21 04:20:35.283517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 667/1372] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:35 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:36.305286 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f837044d-9152-4e91-a062-b256566be701 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:36.305962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f837044d-9152-4e91-a062-b256566be701 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:36.313808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f837044d-9152-4e91-a062-b256566be701 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:36.314319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f837044d-9152-4e91-a062-b256566be701 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:36.315181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f837044d-9152-4e91-a062-b256566be701 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:36.315677 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f837044d-9152-4e91-a062-b256566be701 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:36.450424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f837044d-9152-4e91-a062-b256566be701 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:36.460865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f837044d-9152-4e91-a062-b256566be701 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.164710 Dec 21 04:20:36.461712 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 706/1373] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:36 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:37.485847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-084812f3-8f36-4cc6-8d73-7667ce9472ea tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:37.486469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-084812f3-8f36-4cc6-8d73-7667ce9472ea tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:37.494869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-084812f3-8f36-4cc6-8d73-7667ce9472ea tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:37.495405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-084812f3-8f36-4cc6-8d73-7667ce9472ea tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:37.496242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-084812f3-8f36-4cc6-8d73-7667ce9472ea tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:37.496728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-084812f3-8f36-4cc6-8d73-7667ce9472ea tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:37.631895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-084812f3-8f36-4cc6-8d73-7667ce9472ea tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:37.641196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-084812f3-8f36-4cc6-8d73-7667ce9472ea tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.165126 Dec 21 04:20:37.641788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 668/1374] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:37 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:38.665897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-96367820-4714-4a79-89a8-f62402d390b7 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:38.666505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-96367820-4714-4a79-89a8-f62402d390b7 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:38.674456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-96367820-4714-4a79-89a8-f62402d390b7 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:38.674977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-96367820-4714-4a79-89a8-f62402d390b7 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:38.675799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-96367820-4714-4a79-89a8-f62402d390b7 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:38.677254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-96367820-4714-4a79-89a8-f62402d390b7 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:38.806026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-96367820-4714-4a79-89a8-f62402d390b7 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:38.815317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-96367820-4714-4a79-89a8-f62402d390b7 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.159376 Dec 21 04:20:38.815904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 707/1375] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:38 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:39.838678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7b8c3bc3-ccfd-4d8a-a78b-6ddb19b4069f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:39.839375 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7b8c3bc3-ccfd-4d8a-a78b-6ddb19b4069f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:39.847284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b8c3bc3-ccfd-4d8a-a78b-6ddb19b4069f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:39.847790 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b8c3bc3-ccfd-4d8a-a78b-6ddb19b4069f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:39.848743 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b8c3bc3-ccfd-4d8a-a78b-6ddb19b4069f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:39.849230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b8c3bc3-ccfd-4d8a-a78b-6ddb19b4069f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:39.983299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7b8c3bc3-ccfd-4d8a-a78b-6ddb19b4069f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:39.995973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7b8c3bc3-ccfd-4d8a-a78b-6ddb19b4069f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.166204 Dec 21 04:20:39.996798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 669/1376] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:39 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:41.019601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ea91dac5-dd12-421d-bc71-4a310d1e9368 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:41.020925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ea91dac5-dd12-421d-bc71-4a310d1e9368 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:41.029020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea91dac5-dd12-421d-bc71-4a310d1e9368 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:41.029530 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea91dac5-dd12-421d-bc71-4a310d1e9368 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:41.030361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea91dac5-dd12-421d-bc71-4a310d1e9368 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:41.030855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea91dac5-dd12-421d-bc71-4a310d1e9368 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:41.165657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ea91dac5-dd12-421d-bc71-4a310d1e9368 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:41.174946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ea91dac5-dd12-421d-bc71-4a310d1e9368 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.164656 Dec 21 04:20:41.175542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 708/1377] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:41 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:42.198827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-56994af7-484f-44e5-a09c-e950501610b3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:42.199556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-56994af7-484f-44e5-a09c-e950501610b3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:42.208018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56994af7-484f-44e5-a09c-e950501610b3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:42.208535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56994af7-484f-44e5-a09c-e950501610b3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:42.209367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56994af7-484f-44e5-a09c-e950501610b3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:42.209859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-56994af7-484f-44e5-a09c-e950501610b3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:42.344778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-56994af7-484f-44e5-a09c-e950501610b3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:42.354355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-56994af7-484f-44e5-a09c-e950501610b3 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.164607 Dec 21 04:20:42.354963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 670/1378] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:42 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:43.590296 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7f5fc1f6-b2d7-4d51-bf0d-0acbf20f3f15 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:43.590986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7f5fc1f6-b2d7-4d51-bf0d-0acbf20f3f15 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:43.599675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f5fc1f6-b2d7-4d51-bf0d-0acbf20f3f15 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:43.600186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f5fc1f6-b2d7-4d51-bf0d-0acbf20f3f15 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:43.601024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f5fc1f6-b2d7-4d51-bf0d-0acbf20f3f15 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:43.601473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f5fc1f6-b2d7-4d51-bf0d-0acbf20f3f15 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:43.734038 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7f5fc1f6-b2d7-4d51-bf0d-0acbf20f3f15 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:43.743846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7f5fc1f6-b2d7-4d51-bf0d-0acbf20f3f15 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.375106 Dec 21 04:20:43.744447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 709/1379] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:43 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:44.767037 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dda4e845-d57c-4465-8309-3be417cde882 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:44.767700 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dda4e845-d57c-4465-8309-3be417cde882 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:44.776074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dda4e845-d57c-4465-8309-3be417cde882 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:44.776578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dda4e845-d57c-4465-8309-3be417cde882 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:44.777409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dda4e845-d57c-4465-8309-3be417cde882 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:44.777897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dda4e845-d57c-4465-8309-3be417cde882 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:44.913197 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dda4e845-d57c-4465-8309-3be417cde882 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:44.922586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dda4e845-d57c-4465-8309-3be417cde882 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.164867 Dec 21 04:20:44.923207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 671/1380] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:44 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:45.946877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4241856c-3b8a-43d3-b0d2-cb3342b04b42 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:45.947570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4241856c-3b8a-43d3-b0d2-cb3342b04b42 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:45.955668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4241856c-3b8a-43d3-b0d2-cb3342b04b42 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:45.956096 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4241856c-3b8a-43d3-b0d2-cb3342b04b42 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:45.956927 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4241856c-3b8a-43d3-b0d2-cb3342b04b42 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:45.957649 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4241856c-3b8a-43d3-b0d2-cb3342b04b42 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:46.088078 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4241856c-3b8a-43d3-b0d2-cb3342b04b42 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:46.097548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4241856c-3b8a-43d3-b0d2-cb3342b04b42 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.160874 Dec 21 04:20:46.098636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 710/1381] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:45 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:47.121561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7a3bc18d-cb0f-475d-85a3-c9ced122f63e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:47.122227 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7a3bc18d-cb0f-475d-85a3-c9ced122f63e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:47.130655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a3bc18d-cb0f-475d-85a3-c9ced122f63e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:47.131214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a3bc18d-cb0f-475d-85a3-c9ced122f63e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:47.132049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a3bc18d-cb0f-475d-85a3-c9ced122f63e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:47.132535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7a3bc18d-cb0f-475d-85a3-c9ced122f63e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:47.264055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7a3bc18d-cb0f-475d-85a3-c9ced122f63e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:47.273441 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7a3bc18d-cb0f-475d-85a3-c9ced122f63e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.161709 Dec 21 04:20:47.274027 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 672/1382] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:47 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:48.296335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e455bdfa-0d71-4f56-a108-439390d9415e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:48.296916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e455bdfa-0d71-4f56-a108-439390d9415e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:48.304896 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e455bdfa-0d71-4f56-a108-439390d9415e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:48.305422 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e455bdfa-0d71-4f56-a108-439390d9415e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:48.306213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e455bdfa-0d71-4f56-a108-439390d9415e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:48.306701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e455bdfa-0d71-4f56-a108-439390d9415e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:48.442478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e455bdfa-0d71-4f56-a108-439390d9415e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:48.451902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e455bdfa-0d71-4f56-a108-439390d9415e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.164972 Dec 21 04:20:48.452696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 711/1383] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:48 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:49.476015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e5172132-d890-4fb4-9800-cd6432a03479 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:49.476685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e5172132-d890-4fb4-9800-cd6432a03479 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:49.484572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5172132-d890-4fb4-9800-cd6432a03479 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:49.485078 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5172132-d890-4fb4-9800-cd6432a03479 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:49.485909 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5172132-d890-4fb4-9800-cd6432a03479 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:49.486405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e5172132-d890-4fb4-9800-cd6432a03479 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:49.619051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e5172132-d890-4fb4-9800-cd6432a03479 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:49.628388 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e5172132-d890-4fb4-9800-cd6432a03479 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.162324 Dec 21 04:20:49.629065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 673/1384] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:49 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:50.652109 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8c92deee-d26b-4fff-95a9-0b5940c48696 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:50.652782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8c92deee-d26b-4fff-95a9-0b5940c48696 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:50.661251 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8c92deee-d26b-4fff-95a9-0b5940c48696 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:50.661750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8c92deee-d26b-4fff-95a9-0b5940c48696 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:50.662572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8c92deee-d26b-4fff-95a9-0b5940c48696 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:50.663090 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8c92deee-d26b-4fff-95a9-0b5940c48696 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:50.791241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8c92deee-d26b-4fff-95a9-0b5940c48696 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:50.800447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8c92deee-d26b-4fff-95a9-0b5940c48696 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.157688 Dec 21 04:20:50.801229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 712/1385] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:50 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:51.823788 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5080ee50-ba26-4b46-a110-eddf4f6b7f5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:51.824387 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5080ee50-ba26-4b46-a110-eddf4f6b7f5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:51.832727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5080ee50-ba26-4b46-a110-eddf4f6b7f5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:51.833229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5080ee50-ba26-4b46-a110-eddf4f6b7f5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:51.834054 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5080ee50-ba26-4b46-a110-eddf4f6b7f5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:51.834542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5080ee50-ba26-4b46-a110-eddf4f6b7f5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:51.965973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5080ee50-ba26-4b46-a110-eddf4f6b7f5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:51.975898 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5080ee50-ba26-4b46-a110-eddf4f6b7f5d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.161114 Dec 21 04:20:51.976489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 674/1386] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:51 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:52.999684 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-19f5759a-0148-4143-857b-0e83bbc02e53 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:53.000408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-19f5759a-0148-4143-857b-0e83bbc02e53 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:53.008535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19f5759a-0148-4143-857b-0e83bbc02e53 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:53.009045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19f5759a-0148-4143-857b-0e83bbc02e53 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:53.009877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19f5759a-0148-4143-857b-0e83bbc02e53 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:53.010374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-19f5759a-0148-4143-857b-0e83bbc02e53 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:53.139555 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-19f5759a-0148-4143-857b-0e83bbc02e53 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:53.149707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-19f5759a-0148-4143-857b-0e83bbc02e53 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.159473 Dec 21 04:20:53.150299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 713/1387] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:52 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:54.172693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-348ba43e-4605-4e07-8170-c79ec4e5ec1e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:54.173363 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-348ba43e-4605-4e07-8170-c79ec4e5ec1e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:54.182166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-348ba43e-4605-4e07-8170-c79ec4e5ec1e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:54.182677 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-348ba43e-4605-4e07-8170-c79ec4e5ec1e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:54.183552 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-348ba43e-4605-4e07-8170-c79ec4e5ec1e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:54.184041 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-348ba43e-4605-4e07-8170-c79ec4e5ec1e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:54.317638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-348ba43e-4605-4e07-8170-c79ec4e5ec1e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:54.327261 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-348ba43e-4605-4e07-8170-c79ec4e5ec1e tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.163512 Dec 21 04:20:54.327856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 675/1388] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:54 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:55.351399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-970d5ddf-a8ff-4193-974e-9879f7470d1f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:55.352067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-970d5ddf-a8ff-4193-974e-9879f7470d1f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:55.359937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-970d5ddf-a8ff-4193-974e-9879f7470d1f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:55.360445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-970d5ddf-a8ff-4193-974e-9879f7470d1f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:55.361272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-970d5ddf-a8ff-4193-974e-9879f7470d1f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:55.361763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-970d5ddf-a8ff-4193-974e-9879f7470d1f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:55.500437 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-970d5ddf-a8ff-4193-974e-9879f7470d1f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:55.509824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-970d5ddf-a8ff-4193-974e-9879f7470d1f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.168379 Dec 21 04:20:55.510408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 714/1389] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:55 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:56.533328 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1142a3b4-9190-45e2-a5d3-3db733d198a8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:56.533997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1142a3b4-9190-45e2-a5d3-3db733d198a8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:56.542853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1142a3b4-9190-45e2-a5d3-3db733d198a8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:56.543397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1142a3b4-9190-45e2-a5d3-3db733d198a8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:56.544317 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1142a3b4-9190-45e2-a5d3-3db733d198a8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:56.544823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1142a3b4-9190-45e2-a5d3-3db733d198a8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:56.679550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1142a3b4-9190-45e2-a5d3-3db733d198a8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:56.688921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1142a3b4-9190-45e2-a5d3-3db733d198a8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.164588 Dec 21 04:20:56.689518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 676/1390] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:56 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:57.712540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-fcee5ebe-fe13-45ca-a15a-404a82038046 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:57.713204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-fcee5ebe-fe13-45ca-a15a-404a82038046 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:57.721020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fcee5ebe-fe13-45ca-a15a-404a82038046 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:57.721525 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fcee5ebe-fe13-45ca-a15a-404a82038046 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:57.722689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fcee5ebe-fe13-45ca-a15a-404a82038046 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:57.723208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-fcee5ebe-fe13-45ca-a15a-404a82038046 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:57.855125 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-fcee5ebe-fe13-45ca-a15a-404a82038046 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:57.865244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-fcee5ebe-fe13-45ca-a15a-404a82038046 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.162169 Dec 21 04:20:57.865837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 715/1391] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:57 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:20:58.889151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3cd8f257-cdb8-4a8e-a1a3-731e4a48d390 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:20:58.889747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3cd8f257-cdb8-4a8e-a1a3-731e4a48d390 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:20:58.898295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3cd8f257-cdb8-4a8e-a1a3-731e4a48d390 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:58.898799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3cd8f257-cdb8-4a8e-a1a3-731e4a48d390 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:58.899667 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3cd8f257-cdb8-4a8e-a1a3-731e4a48d390 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:20:58.900162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3cd8f257-cdb8-4a8e-a1a3-731e4a48d390 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:20:59.043777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3cd8f257-cdb8-4a8e-a1a3-731e4a48d390 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:20:59.053500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3cd8f257-cdb8-4a8e-a1a3-731e4a48d390 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.173451 Dec 21 04:20:59.054097 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 677/1392] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:20:58 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:00.077058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0a467c51-fd69-4011-b169-915f72f0e4b5 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:00.077733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0a467c51-fd69-4011-b169-915f72f0e4b5 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:00.086500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a467c51-fd69-4011-b169-915f72f0e4b5 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:00.087045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a467c51-fd69-4011-b169-915f72f0e4b5 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:00.087896 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a467c51-fd69-4011-b169-915f72f0e4b5 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:00.088390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a467c51-fd69-4011-b169-915f72f0e4b5 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:00.224316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0a467c51-fd69-4011-b169-915f72f0e4b5 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:00.233639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0a467c51-fd69-4011-b169-915f72f0e4b5 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.165612 Dec 21 04:21:00.234240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 716/1393] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:00 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:01.258218 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6dda59c9-fd97-45d2-9514-4ed4e4020674 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:01.258883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6dda59c9-fd97-45d2-9514-4ed4e4020674 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:01.267463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6dda59c9-fd97-45d2-9514-4ed4e4020674 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:01.268055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6dda59c9-fd97-45d2-9514-4ed4e4020674 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:01.268899 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6dda59c9-fd97-45d2-9514-4ed4e4020674 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:01.269585 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6dda59c9-fd97-45d2-9514-4ed4e4020674 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:01.403972 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6dda59c9-fd97-45d2-9514-4ed4e4020674 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:01.414250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6dda59c9-fd97-45d2-9514-4ed4e4020674 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.165691 Dec 21 04:21:01.414849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 678/1394] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:01 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:02.437602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1c5cb320-7de1-4e4a-ad93-1b14cf320060 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:02.438271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1c5cb320-7de1-4e4a-ad93-1b14cf320060 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:02.446367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1c5cb320-7de1-4e4a-ad93-1b14cf320060 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:02.446877 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1c5cb320-7de1-4e4a-ad93-1b14cf320060 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:02.447740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1c5cb320-7de1-4e4a-ad93-1b14cf320060 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:02.448230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1c5cb320-7de1-4e4a-ad93-1b14cf320060 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:02.587751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1c5cb320-7de1-4e4a-ad93-1b14cf320060 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:02.597350 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1c5cb320-7de1-4e4a-ad93-1b14cf320060 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.168901 Dec 21 04:21:02.597940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 717/1395] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:02 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:03.620609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-69125af8-0d46-4380-a7bb-1814b43a515a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:03.621269 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-69125af8-0d46-4380-a7bb-1814b43a515a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:03.629038 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69125af8-0d46-4380-a7bb-1814b43a515a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:03.629537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69125af8-0d46-4380-a7bb-1814b43a515a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:03.630364 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69125af8-0d46-4380-a7bb-1814b43a515a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:03.630847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69125af8-0d46-4380-a7bb-1814b43a515a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:03.765024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-69125af8-0d46-4380-a7bb-1814b43a515a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:03.775314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-69125af8-0d46-4380-a7bb-1814b43a515a tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.164165 Dec 21 04:21:03.775903 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 679/1396] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:03 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:04.798710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-16d8daf6-416c-437f-a1ac-17e5824bd7c4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:04.799460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-16d8daf6-416c-437f-a1ac-17e5824bd7c4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:04.808104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16d8daf6-416c-437f-a1ac-17e5824bd7c4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:04.808611 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16d8daf6-416c-437f-a1ac-17e5824bd7c4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:04.809439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16d8daf6-416c-437f-a1ac-17e5824bd7c4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:04.809934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16d8daf6-416c-437f-a1ac-17e5824bd7c4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:04.939675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-16d8daf6-416c-437f-a1ac-17e5824bd7c4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:04.949003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-16d8daf6-416c-437f-a1ac-17e5824bd7c4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.159239 Dec 21 04:21:04.949515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 718/1397] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:04 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:05.971036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-adbfca47-b159-4cf3-9e2f-13d46e1cdf07 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:05.971709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-adbfca47-b159-4cf3-9e2f-13d46e1cdf07 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:05.979751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-adbfca47-b159-4cf3-9e2f-13d46e1cdf07 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:05.980258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-adbfca47-b159-4cf3-9e2f-13d46e1cdf07 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:05.981095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-adbfca47-b159-4cf3-9e2f-13d46e1cdf07 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:05.981590 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-adbfca47-b159-4cf3-9e2f-13d46e1cdf07 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:06.110650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-adbfca47-b159-4cf3-9e2f-13d46e1cdf07 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:06.120940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-adbfca47-b159-4cf3-9e2f-13d46e1cdf07 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.158958 Dec 21 04:21:06.121484 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 680/1398] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:05 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:07.143964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4b1e8d6d-7aca-4a36-94a3-cb3f5870ab41 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:07.145081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4b1e8d6d-7aca-4a36-94a3-cb3f5870ab41 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:07.152916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b1e8d6d-7aca-4a36-94a3-cb3f5870ab41 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:07.153418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b1e8d6d-7aca-4a36-94a3-cb3f5870ab41 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:07.154244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b1e8d6d-7aca-4a36-94a3-cb3f5870ab41 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:07.154732 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b1e8d6d-7aca-4a36-94a3-cb3f5870ab41 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:07.283359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4b1e8d6d-7aca-4a36-94a3-cb3f5870ab41 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:07.293140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4b1e8d6d-7aca-4a36-94a3-cb3f5870ab41 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.158454 Dec 21 04:21:07.293729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 719/1399] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:07 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:08.317342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e55f5bec-9cc9-439b-8b1d-e6dc27fe0ceb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:08.317950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e55f5bec-9cc9-439b-8b1d-e6dc27fe0ceb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:08.325848 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e55f5bec-9cc9-439b-8b1d-e6dc27fe0ceb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:08.326360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e55f5bec-9cc9-439b-8b1d-e6dc27fe0ceb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:08.327240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e55f5bec-9cc9-439b-8b1d-e6dc27fe0ceb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:08.327735 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e55f5bec-9cc9-439b-8b1d-e6dc27fe0ceb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:08.462424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e55f5bec-9cc9-439b-8b1d-e6dc27fe0ceb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:08.472584 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e55f5bec-9cc9-439b-8b1d-e6dc27fe0ceb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.164834 Dec 21 04:21:08.473186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 681/1400] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:08 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:09.496065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3720edb1-dddf-4d3b-b3b9-af61992ff8e4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:09.496739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3720edb1-dddf-4d3b-b3b9-af61992ff8e4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:09.504670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3720edb1-dddf-4d3b-b3b9-af61992ff8e4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:09.505174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3720edb1-dddf-4d3b-b3b9-af61992ff8e4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:09.506006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3720edb1-dddf-4d3b-b3b9-af61992ff8e4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:09.506497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3720edb1-dddf-4d3b-b3b9-af61992ff8e4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:09.642888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3720edb1-dddf-4d3b-b3b9-af61992ff8e4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:09.652863 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3720edb1-dddf-4d3b-b3b9-af61992ff8e4 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.166151 Dec 21 04:21:09.653449 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 720/1401] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:09 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:10.676851 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-afa6db85-b78c-4c36-bf51-4176296b1064 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:10.677457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-afa6db85-b78c-4c36-bf51-4176296b1064 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:10.685417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-afa6db85-b78c-4c36-bf51-4176296b1064 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:10.685930 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-afa6db85-b78c-4c36-bf51-4176296b1064 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:10.686754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-afa6db85-b78c-4c36-bf51-4176296b1064 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:10.687279 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-afa6db85-b78c-4c36-bf51-4176296b1064 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:10.954354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-afa6db85-b78c-4c36-bf51-4176296b1064 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:10.964954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-afa6db85-b78c-4c36-bf51-4176296b1064 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.297877 Dec 21 04:21:10.965556 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 682/1402] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:10 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:11.987921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-485851d8-432e-48dc-b9da-32277fae3eaf tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:11.988652 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-485851d8-432e-48dc-b9da-32277fae3eaf tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:11.996770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-485851d8-432e-48dc-b9da-32277fae3eaf tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:11.997282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-485851d8-432e-48dc-b9da-32277fae3eaf tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:11.998179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-485851d8-432e-48dc-b9da-32277fae3eaf tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:11.998672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-485851d8-432e-48dc-b9da-32277fae3eaf tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:12.130031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-485851d8-432e-48dc-b9da-32277fae3eaf tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:12.139419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-485851d8-432e-48dc-b9da-32277fae3eaf tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.160768 Dec 21 04:21:12.140011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 721/1403] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:11 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:13.163097 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c073842c-1ba9-4080-a0a2-a02115e2e25c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:13.163762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c073842c-1ba9-4080-a0a2-a02115e2e25c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:13.171574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c073842c-1ba9-4080-a0a2-a02115e2e25c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:13.172076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c073842c-1ba9-4080-a0a2-a02115e2e25c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:13.172905 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c073842c-1ba9-4080-a0a2-a02115e2e25c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:13.173397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c073842c-1ba9-4080-a0a2-a02115e2e25c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:13.304405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c073842c-1ba9-4080-a0a2-a02115e2e25c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:13.313800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c073842c-1ba9-4080-a0a2-a02115e2e25c tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.160043 Dec 21 04:21:13.314384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 683/1404] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:13 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:14.337986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2be1d740-bf62-481f-91b6-371e2e22fed8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:14.338654 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2be1d740-bf62-481f-91b6-371e2e22fed8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:14.346489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2be1d740-bf62-481f-91b6-371e2e22fed8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:14.347056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2be1d740-bf62-481f-91b6-371e2e22fed8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:14.347896 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2be1d740-bf62-481f-91b6-371e2e22fed8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:14.348390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2be1d740-bf62-481f-91b6-371e2e22fed8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:14.480244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2be1d740-bf62-481f-91b6-371e2e22fed8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:14.490166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2be1d740-bf62-481f-91b6-371e2e22fed8 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.161932 Dec 21 04:21:14.490773 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 722/1405] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:14 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:15.513804 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b32d8bdc-9785-4735-acec-7d439303bedb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:15.514473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b32d8bdc-9785-4735-acec-7d439303bedb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:15.523186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b32d8bdc-9785-4735-acec-7d439303bedb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:15.523703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b32d8bdc-9785-4735-acec-7d439303bedb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:15.524548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b32d8bdc-9785-4735-acec-7d439303bedb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:15.525047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b32d8bdc-9785-4735-acec-7d439303bedb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:15.658614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b32d8bdc-9785-4735-acec-7d439303bedb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:15.668357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b32d8bdc-9785-4735-acec-7d439303bedb tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.163471 Dec 21 04:21:15.668969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 684/1406] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:15 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:16.692026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3a466466-4dd8-4a0f-8897-a58da03e6c20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:16.692704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3a466466-4dd8-4a0f-8897-a58da03e6c20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:16.700971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a466466-4dd8-4a0f-8897-a58da03e6c20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:16.701543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a466466-4dd8-4a0f-8897-a58da03e6c20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:16.702869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a466466-4dd8-4a0f-8897-a58da03e6c20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:16.703424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3a466466-4dd8-4a0f-8897-a58da03e6c20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:16.862176 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3a466466-4dd8-4a0f-8897-a58da03e6c20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:16.872473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3a466466-4dd8-4a0f-8897-a58da03e6c20 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.190341 Dec 21 04:21:16.873085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 723/1407] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:16 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:17.899502 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c39e8c28-eb08-42e0-9a3a-c6d3931fc65d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:17.900164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c39e8c28-eb08-42e0-9a3a-c6d3931fc65d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:17.908727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c39e8c28-eb08-42e0-9a3a-c6d3931fc65d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:17.909338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c39e8c28-eb08-42e0-9a3a-c6d3931fc65d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:17.910172 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c39e8c28-eb08-42e0-9a3a-c6d3931fc65d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:17.910663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c39e8c28-eb08-42e0-9a3a-c6d3931fc65d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:18.043858 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c39e8c28-eb08-42e0-9a3a-c6d3931fc65d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:18.053723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c39e8c28-eb08-42e0-9a3a-c6d3931fc65d tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.163272 Dec 21 04:21:18.054337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 685/1408] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:17 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:19.077075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e04d517b-b8a2-423c-b51d-c33b1bebe6db tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:19.077738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e04d517b-b8a2-423c-b51d-c33b1bebe6db tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:19.085611 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e04d517b-b8a2-423c-b51d-c33b1bebe6db tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:19.086113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e04d517b-b8a2-423c-b51d-c33b1bebe6db tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:19.086956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e04d517b-b8a2-423c-b51d-c33b1bebe6db tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:19.087451 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e04d517b-b8a2-423c-b51d-c33b1bebe6db tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:19.217738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e04d517b-b8a2-423c-b51d-c33b1bebe6db tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:19.227247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e04d517b-b8a2-423c-b51d-c33b1bebe6db tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.159233 Dec 21 04:21:19.227839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 724/1409] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:19 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:20.251075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-83340a00-fc23-48d3-bd3f-0c0ffc07f966 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:20.252206 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-83340a00-fc23-48d3-bd3f-0c0ffc07f966 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:20.260506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83340a00-fc23-48d3-bd3f-0c0ffc07f966 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:20.261009 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83340a00-fc23-48d3-bd3f-0c0ffc07f966 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:20.261834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83340a00-fc23-48d3-bd3f-0c0ffc07f966 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:20.262325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-83340a00-fc23-48d3-bd3f-0c0ffc07f966 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:20.391809 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-83340a00-fc23-48d3-bd3f-0c0ffc07f966 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:20.401704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-83340a00-fc23-48d3-bd3f-0c0ffc07f966 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.159995 Dec 21 04:21:20.402296 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 686/1410] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:20 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:21.435424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-09f38db5-0beb-47dd-812c-145e7b71b482 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:21.436088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-09f38db5-0beb-47dd-812c-145e7b71b482 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:21.444321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09f38db5-0beb-47dd-812c-145e7b71b482 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:21.444833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09f38db5-0beb-47dd-812c-145e7b71b482 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:21.445679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09f38db5-0beb-47dd-812c-145e7b71b482 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:21.446179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09f38db5-0beb-47dd-812c-145e7b71b482 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:21.577468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-09f38db5-0beb-47dd-812c-145e7b71b482 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:21.587904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-09f38db5-0beb-47dd-812c-145e7b71b482 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.161628 Dec 21 04:21:21.588501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 725/1411] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:21 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:22.611687 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bccbbf3a-30ce-4033-9d02-946d1ede744f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:22.613155 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bccbbf3a-30ce-4033-9d02-946d1ede744f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:22.621373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bccbbf3a-30ce-4033-9d02-946d1ede744f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:22.621885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bccbbf3a-30ce-4033-9d02-946d1ede744f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:22.622721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bccbbf3a-30ce-4033-9d02-946d1ede744f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:22.623246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bccbbf3a-30ce-4033-9d02-946d1ede744f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:22.757379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-bccbbf3a-30ce-4033-9d02-946d1ede744f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:22.766713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bccbbf3a-30ce-4033-9d02-946d1ede744f tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.163967 Dec 21 04:21:22.767325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 687/1412] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:22 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:23.790307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-88113f2f-e567-4016-9915-585bdf9b9401 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:23.791036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-88113f2f-e567-4016-9915-585bdf9b9401 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:23.798862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88113f2f-e567-4016-9915-585bdf9b9401 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:23.799938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88113f2f-e567-4016-9915-585bdf9b9401 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:23.800758 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88113f2f-e567-4016-9915-585bdf9b9401 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:23.801253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88113f2f-e567-4016-9915-585bdf9b9401 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:23.936640 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-88113f2f-e567-4016-9915-585bdf9b9401 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:23.946079 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-88113f2f-e567-4016-9915-585bdf9b9401 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.164890 Dec 21 04:21:23.946683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 726/1413] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:23 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:24.969695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2e063fd2-9b1b-46c9-b2da-a8b2c7bd95c6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:24.970298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2e063fd2-9b1b-46c9-b2da-a8b2c7bd95c6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:24.978226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e063fd2-9b1b-46c9-b2da-a8b2c7bd95c6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:24.978733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e063fd2-9b1b-46c9-b2da-a8b2c7bd95c6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:24.979596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e063fd2-9b1b-46c9-b2da-a8b2c7bd95c6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:24.980092 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2e063fd2-9b1b-46c9-b2da-a8b2c7bd95c6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:25.326025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2e063fd2-9b1b-46c9-b2da-a8b2c7bd95c6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4617f0566845acb67b02c72c97856b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fc3096c5c34fe8b975ecce478f85fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:21:25.335528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2e063fd2-9b1b-46c9-b2da-a8b2c7bd95c6 tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 200 len: 1350 microversion: 2.1 time: 0.374835 Dec 21 04:21:25.336567 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 688/1414] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:24 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 1350 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:21:26.358619 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f0986422-cb0e-4a9e-9994-d8554dc97dad tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:21:26.359633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f0986422-cb0e-4a9e-9994-d8554dc97dad tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] [instance: 63061bb7-38e7-4c2a-ac1d-eb8752fa584e] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:21:26.368060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0986422-cb0e-4a9e-9994-d8554dc97dad tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:26.368550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0986422-cb0e-4a9e-9994-d8554dc97dad tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:26.369384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0986422-cb0e-4a9e-9994-d8554dc97dad tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:21:26.369876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f0986422-cb0e-4a9e-9994-d8554dc97dad tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:21:26.422710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-f0986422-cb0e-4a9e-9994-d8554dc97dad tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] HTTP exception thrown: Instance 63061bb7-38e7-4c2a-ac1d-eb8752fa584e could not be found. Dec 21 04:21:26.423410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f0986422-cb0e-4a9e-9994-d8554dc97dad tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] Returning 404 to user: Instance 63061bb7-38e7-4c2a-ac1d-eb8752fa584e could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:21:26.424337 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f0986422-cb0e-4a9e-9994-d8554dc97dad tempest-VolumesSnapshotTestJSON-1565489529 tempest-VolumesSnapshotTestJSON-1565489529] 10.222.0.16 "GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e" status: 404 len: 111 microversion: 2.1 time: 0.074770 Dec 21 04:21:26.425011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 727/1415] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:21:26 2020] GET /compute/v2.1/servers/63061bb7-38e7-4c2a-ac1d-eb8752fa584e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:22:07.250706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:22:07.251262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:22:07 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:22:20.101862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a737f859-1905-47dd-afcb-d205963849b2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:20.102410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a737f859-1905-47dd-afcb-d205963849b2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:20.110964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a737f859-1905-47dd-afcb-d205963849b2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:20.111466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a737f859-1905-47dd-afcb-d205963849b2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:20.112299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a737f859-1905-47dd-afcb-d205963849b2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:20.112794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a737f859-1905-47dd-afcb-d205963849b2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:20.166027 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-a737f859-1905-47dd-afcb-d205963849b2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] HTTP exception thrown: Instance c01a14ee-b77e-4ed8-a7e7-deff054230f2 could not be found. Dec 21 04:22:20.166626 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a737f859-1905-47dd-afcb-d205963849b2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Returning 404 to user: Instance c01a14ee-b77e-4ed8-a7e7-deff054230f2 could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:22:20.167545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a737f859-1905-47dd-afcb-d205963849b2 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "DELETE /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 404 len: 111 microversion: 2.1 time: 0.074945 Dec 21 04:22:20.168127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 689/1416] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:22:20 2020] DELETE /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:22:20.182253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a4508fe5-44cf-4bf1-b714-531e574adda9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:20.182947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a4508fe5-44cf-4bf1-b714-531e574adda9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: c01a14ee-b77e-4ed8-a7e7-deff054230f2] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:20.191702 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4508fe5-44cf-4bf1-b714-531e574adda9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:20.192203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4508fe5-44cf-4bf1-b714-531e574adda9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:20.193065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4508fe5-44cf-4bf1-b714-531e574adda9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:20.193557 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4508fe5-44cf-4bf1-b714-531e574adda9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:20.247069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-a4508fe5-44cf-4bf1-b714-531e574adda9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] HTTP exception thrown: Instance c01a14ee-b77e-4ed8-a7e7-deff054230f2 could not be found. Dec 21 04:22:20.247731 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a4508fe5-44cf-4bf1-b714-531e574adda9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Returning 404 to user: Instance c01a14ee-b77e-4ed8-a7e7-deff054230f2 could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:22:20.248625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a4508fe5-44cf-4bf1-b714-531e574adda9 tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2" status: 404 len: 111 microversion: 2.1 time: 0.076111 Dec 21 04:22:20.249230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 728/1417] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:20 2020] GET /compute/v2.1/servers/c01a14ee-b77e-4ed8-a7e7-deff054230f2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:22:22.299313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-11ae667d-b346-4dd1-8e19-4f4d6578f1d1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:22.299856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-11ae667d-b346-4dd1-8e19-4f4d6578f1d1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:22.307578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11ae667d-b346-4dd1-8e19-4f4d6578f1d1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:22.308080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11ae667d-b346-4dd1-8e19-4f4d6578f1d1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:22.308895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11ae667d-b346-4dd1-8e19-4f4d6578f1d1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:22.309387 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11ae667d-b346-4dd1-8e19-4f4d6578f1d1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:22.378473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-11ae667d-b346-4dd1-8e19-4f4d6578f1d1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Going to try to terminate instance {{(pid=94298) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:22:22.499369 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-11ae667d-b346-4dd1-8e19-4f4d6578f1d1 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "DELETE /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 204 len: 0 microversion: 2.1 time: 0.208772 Dec 21 04:22:22.500900 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 690/1418] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:22:22 2020] DELETE /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:22:22.517072 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-be039c8d-6e9f-442b-9cca-b506fd738760 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:22.517888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-be039c8d-6e9f-442b-9cca-b506fd738760 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:22.525692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be039c8d-6e9f-442b-9cca-b506fd738760 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:22.526194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be039c8d-6e9f-442b-9cca-b506fd738760 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:22.527043 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be039c8d-6e9f-442b-9cca-b506fd738760 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:22.527531 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-be039c8d-6e9f-442b-9cca-b506fd738760 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:22.792124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-be039c8d-6e9f-442b-9cca-b506fd738760 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:22.802294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-be039c8d-6e9f-442b-9cca-b506fd738760 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1602 microversion: 2.1 time: 0.296650 Dec 21 04:22:22.802928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 729/1419] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:22 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1602 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:23.640666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-7853a549-b982-4e3d-b722-5865739f6d94 req-ba82b1fe-ce14-44a2-86c2-6e813eacfe58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa828a0-c810-48fe-8ea0-866c312aeb98", "name": "network-vif-unplugged", "status": "completed", "tag": "a286529e-ec58-4881-9bf1-0a30fd25f4af"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:22:23.647954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:23.647954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:22:23.658247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-7853a549-b982-4e3d-b722-5865739f6d94 req-ba82b1fe-ce14-44a2-86c2-6e813eacfe58 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:23.658751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-7853a549-b982-4e3d-b722-5865739f6d94 req-ba82b1fe-ce14-44a2-86c2-6e813eacfe58 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:23.679639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-7853a549-b982-4e3d-b722-5865739f6d94 req-ba82b1fe-ce14-44a2-86c2-6e813eacfe58 service nova] Creating event network-vif-unplugged:a286529e-ec58-4881-9bf1-0a30fd25f4af for instance daa828a0-c810-48fe-8ea0-866c312aeb98 on hv-cinder-73306 Dec 21 04:22:23.684893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-7853a549-b982-4e3d-b722-5865739f6d94 req-ba82b1fe-ce14-44a2-86c2-6e813eacfe58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.192822 Dec 21 04:22:23.685625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 691/1420] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:22:23 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:22:23.826697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f1ca5e1b-e272-44fa-bd70-65c344921d3e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:23.827397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f1ca5e1b-e272-44fa-bd70-65c344921d3e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:23.835728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f1ca5e1b-e272-44fa-bd70-65c344921d3e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:23.836240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f1ca5e1b-e272-44fa-bd70-65c344921d3e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:23.837078 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f1ca5e1b-e272-44fa-bd70-65c344921d3e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:23.837572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f1ca5e1b-e272-44fa-bd70-65c344921d3e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:24.062458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f1ca5e1b-e272-44fa-bd70-65c344921d3e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:24.072632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f1ca5e1b-e272-44fa-bd70-65c344921d3e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1602 microversion: 2.1 time: 0.255063 Dec 21 04:22:24.073221 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 730/1421] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:23 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1602 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:25.048706 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-b5355765-410b-4a9d-926c-19e4a87fb3fd req-b4cebfdb-d55a-4878-bc33-69f8dc5114c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa828a0-c810-48fe-8ea0-866c312aeb98", "name": "network-vif-deleted", "tag": "a286529e-ec58-4881-9bf1-0a30fd25f4af"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:22:25.057367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:25.057367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:22:25.068373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-b5355765-410b-4a9d-926c-19e4a87fb3fd req-b4cebfdb-d55a-4878-bc33-69f8dc5114c5 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:25.068846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-b5355765-410b-4a9d-926c-19e4a87fb3fd req-b4cebfdb-d55a-4878-bc33-69f8dc5114c5 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:25.088513 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-b5355765-410b-4a9d-926c-19e4a87fb3fd req-b4cebfdb-d55a-4878-bc33-69f8dc5114c5 service nova] Creating event network-vif-deleted:a286529e-ec58-4881-9bf1-0a30fd25f4af for instance daa828a0-c810-48fe-8ea0-866c312aeb98 on hv-cinder-73306 Dec 21 04:22:25.094826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-b5355765-410b-4a9d-926c-19e4a87fb3fd req-b4cebfdb-d55a-4878-bc33-69f8dc5114c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056202 Dec 21 04:22:25.095670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 692/1422] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:22:25 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:22:25.098484 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7b294cfd-17b9-488d-b2c3-fdfbfe0bbfa3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:25.099240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7b294cfd-17b9-488d-b2c3-fdfbfe0bbfa3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:25.107240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b294cfd-17b9-488d-b2c3-fdfbfe0bbfa3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:25.107742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b294cfd-17b9-488d-b2c3-fdfbfe0bbfa3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:25.108564 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b294cfd-17b9-488d-b2c3-fdfbfe0bbfa3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:25.109064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7b294cfd-17b9-488d-b2c3-fdfbfe0bbfa3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:25.239787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7b294cfd-17b9-488d-b2c3-fdfbfe0bbfa3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:25.249411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7b294cfd-17b9-488d-b2c3-fdfbfe0bbfa3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.161461 Dec 21 04:22:25.250007 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 731/1423] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:25 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:22:26.050824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:22:26.051335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:22:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:22:26.274320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dc36da53-137a-4e6b-8f69-c20db6646433 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:26.275134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dc36da53-137a-4e6b-8f69-c20db6646433 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:26.283518 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc36da53-137a-4e6b-8f69-c20db6646433 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:26.283973 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc36da53-137a-4e6b-8f69-c20db6646433 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:26.284792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc36da53-137a-4e6b-8f69-c20db6646433 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:26.285279 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc36da53-137a-4e6b-8f69-c20db6646433 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:26.429067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dc36da53-137a-4e6b-8f69-c20db6646433 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:26.439316 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dc36da53-137a-4e6b-8f69-c20db6646433 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.175465 Dec 21 04:22:26.439921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 693/1424] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:26 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:26.474283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:22:26.474481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:22:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:22:27.463808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0ed39670-ef7a-4f40-871f-ca21598713c9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:27.464409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0ed39670-ef7a-4f40-871f-ca21598713c9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:27.473370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ed39670-ef7a-4f40-871f-ca21598713c9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:27.473885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ed39670-ef7a-4f40-871f-ca21598713c9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:27.474723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ed39670-ef7a-4f40-871f-ca21598713c9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:27.475250 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ed39670-ef7a-4f40-871f-ca21598713c9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:27.612765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0ed39670-ef7a-4f40-871f-ca21598713c9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:27.622377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0ed39670-ef7a-4f40-871f-ca21598713c9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.168885 Dec 21 04:22:27.623016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 732/1425] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:27 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:28.646452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0cf65b55-a126-4b90-bc98-f87496dd2745 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:28.647141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0cf65b55-a126-4b90-bc98-f87496dd2745 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:28.655526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0cf65b55-a126-4b90-bc98-f87496dd2745 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:28.656031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0cf65b55-a126-4b90-bc98-f87496dd2745 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:28.657669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0cf65b55-a126-4b90-bc98-f87496dd2745 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:28.658169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0cf65b55-a126-4b90-bc98-f87496dd2745 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:28.793179 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0cf65b55-a126-4b90-bc98-f87496dd2745 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:28.802866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0cf65b55-a126-4b90-bc98-f87496dd2745 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.165794 Dec 21 04:22:28.803476 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 694/1426] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:28 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:29.826342 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7accc396-ad27-46b5-9582-18edba138158 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:29.827028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7accc396-ad27-46b5-9582-18edba138158 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:29.834836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7accc396-ad27-46b5-9582-18edba138158 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:29.835370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7accc396-ad27-46b5-9582-18edba138158 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:29.836195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7accc396-ad27-46b5-9582-18edba138158 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:29.836680 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7accc396-ad27-46b5-9582-18edba138158 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:29.965371 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7accc396-ad27-46b5-9582-18edba138158 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:29.975294 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7accc396-ad27-46b5-9582-18edba138158 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.158198 Dec 21 04:22:29.975883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 733/1427] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:29 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:30.999665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-594c0b67-fef7-49b3-a1ea-7498abd52f8a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:31.000941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-594c0b67-fef7-49b3-a1ea-7498abd52f8a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:31.009061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-594c0b67-fef7-49b3-a1ea-7498abd52f8a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:31.009561 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-594c0b67-fef7-49b3-a1ea-7498abd52f8a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:31.010384 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-594c0b67-fef7-49b3-a1ea-7498abd52f8a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:31.010871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-594c0b67-fef7-49b3-a1ea-7498abd52f8a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:31.145283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-594c0b67-fef7-49b3-a1ea-7498abd52f8a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:31.154496 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-594c0b67-fef7-49b3-a1ea-7498abd52f8a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.164492 Dec 21 04:22:31.155115 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 695/1428] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:30 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:32.177918 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6c059c16-514b-4432-9b57-41bb82f1247d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:32.178577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6c059c16-514b-4432-9b57-41bb82f1247d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:32.186473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c059c16-514b-4432-9b57-41bb82f1247d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:32.187015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c059c16-514b-4432-9b57-41bb82f1247d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:32.188353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c059c16-514b-4432-9b57-41bb82f1247d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:32.188845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6c059c16-514b-4432-9b57-41bb82f1247d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:32.319847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6c059c16-514b-4432-9b57-41bb82f1247d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:32.329771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6c059c16-514b-4432-9b57-41bb82f1247d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.160959 Dec 21 04:22:32.330372 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 734/1429] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:32 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:33.353512 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4bf13dcc-e0d6-4d00-93c1-709c2ae1e3ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:33.354120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4bf13dcc-e0d6-4d00-93c1-709c2ae1e3ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:33.362286 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4bf13dcc-e0d6-4d00-93c1-709c2ae1e3ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:33.362797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4bf13dcc-e0d6-4d00-93c1-709c2ae1e3ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:33.363670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4bf13dcc-e0d6-4d00-93c1-709c2ae1e3ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:33.364168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4bf13dcc-e0d6-4d00-93c1-709c2ae1e3ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:33.496257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4bf13dcc-e0d6-4d00-93c1-709c2ae1e3ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:33.505966 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4bf13dcc-e0d6-4d00-93c1-709c2ae1e3ea tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.162013 Dec 21 04:22:33.506573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 696/1430] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:33 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:34.530266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6f8953d7-c8c3-49a2-91e0-43520d99be89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:34.530958 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6f8953d7-c8c3-49a2-91e0-43520d99be89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:34.539336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f8953d7-c8c3-49a2-91e0-43520d99be89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:34.539847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f8953d7-c8c3-49a2-91e0-43520d99be89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:34.540678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f8953d7-c8c3-49a2-91e0-43520d99be89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:34.541175 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6f8953d7-c8c3-49a2-91e0-43520d99be89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:34.677259 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6f8953d7-c8c3-49a2-91e0-43520d99be89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:34.686681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6f8953d7-c8c3-49a2-91e0-43520d99be89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.165575 Dec 21 04:22:34.687307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 735/1431] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:34 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:35.710600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-483f01d6-0c7a-4410-90a0-c6e80fe58f5a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:35.711302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-483f01d6-0c7a-4410-90a0-c6e80fe58f5a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:35.720119 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-483f01d6-0c7a-4410-90a0-c6e80fe58f5a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:35.720630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-483f01d6-0c7a-4410-90a0-c6e80fe58f5a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:35.721468 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-483f01d6-0c7a-4410-90a0-c6e80fe58f5a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:35.721960 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-483f01d6-0c7a-4410-90a0-c6e80fe58f5a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:35.851573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-483f01d6-0c7a-4410-90a0-c6e80fe58f5a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:35.861121 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-483f01d6-0c7a-4410-90a0-c6e80fe58f5a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.160525 Dec 21 04:22:35.861721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 697/1432] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:35 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:36.884044 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4ad768b5-baf3-44e4-8ecf-29371d130c16 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:36.884707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4ad768b5-baf3-44e4-8ecf-29371d130c16 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:36.892505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4ad768b5-baf3-44e4-8ecf-29371d130c16 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:36.893013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4ad768b5-baf3-44e4-8ecf-29371d130c16 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:36.893839 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4ad768b5-baf3-44e4-8ecf-29371d130c16 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:36.894326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4ad768b5-baf3-44e4-8ecf-29371d130c16 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:36.977761 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:22:36.978003 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:22:36 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 (ip 10.222.0.16) !!! Dec 21 04:22:37.024471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4ad768b5-baf3-44e4-8ecf-29371d130c16 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:37.034820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4ad768b5-baf3-44e4-8ecf-29371d130c16 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.159933 Dec 21 04:22:37.035457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 736/1433] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:36 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:38.058742 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-724315c0-a73a-40c5-8489-485cfce6ab34 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:38.059382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-724315c0-a73a-40c5-8489-485cfce6ab34 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:38.067881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-724315c0-a73a-40c5-8489-485cfce6ab34 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:38.068391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-724315c0-a73a-40c5-8489-485cfce6ab34 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:38.069223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-724315c0-a73a-40c5-8489-485cfce6ab34 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:38.069719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-724315c0-a73a-40c5-8489-485cfce6ab34 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:38.206716 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-724315c0-a73a-40c5-8489-485cfce6ab34 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:38.216092 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-724315c0-a73a-40c5-8489-485cfce6ab34 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.166460 Dec 21 04:22:38.216678 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 698/1434] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:38 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:39.240260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4a6a7126-e122-4ec2-a7cb-a417fada3a80 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:39.240943 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4a6a7126-e122-4ec2-a7cb-a417fada3a80 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:39.249072 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4a6a7126-e122-4ec2-a7cb-a417fada3a80 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:39.249587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4a6a7126-e122-4ec2-a7cb-a417fada3a80 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:39.251224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4a6a7126-e122-4ec2-a7cb-a417fada3a80 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:39.252187 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4a6a7126-e122-4ec2-a7cb-a417fada3a80 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:39.385009 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4a6a7126-e122-4ec2-a7cb-a417fada3a80 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:39.394767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4a6a7126-e122-4ec2-a7cb-a417fada3a80 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.164285 Dec 21 04:22:39.395387 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 737/1435] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:39 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:40.418067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8922bf7d-c29b-4bed-97f9-590e3dd1c199 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:40.418737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8922bf7d-c29b-4bed-97f9-590e3dd1c199 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:40.427230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8922bf7d-c29b-4bed-97f9-590e3dd1c199 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:40.427741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8922bf7d-c29b-4bed-97f9-590e3dd1c199 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:40.428574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8922bf7d-c29b-4bed-97f9-590e3dd1c199 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:40.429068 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8922bf7d-c29b-4bed-97f9-590e3dd1c199 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:40.559265 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8922bf7d-c29b-4bed-97f9-590e3dd1c199 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:40.568668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8922bf7d-c29b-4bed-97f9-590e3dd1c199 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.159595 Dec 21 04:22:40.569259 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 699/1436] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:40 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:41.476163 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-978ab670-ac41-4f2d-9ed2-570410505ca6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:41.476725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-978ab670-ac41-4f2d-9ed2-570410505ca6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:41.484720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-978ab670-ac41-4f2d-9ed2-570410505ca6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:41.485231 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-978ab670-ac41-4f2d-9ed2-570410505ca6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:41.486072 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-978ab670-ac41-4f2d-9ed2-570410505ca6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:41.486562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-978ab670-ac41-4f2d-9ed2-570410505ca6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:41.560931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-978ab670-ac41-4f2d-9ed2-570410505ca6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Going to try to terminate instance {{(pid=94299) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:22:41.591608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2081b995-8180-4cc0-a970-da551980148a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:41.592272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2081b995-8180-4cc0-a970-da551980148a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:41.600326 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2081b995-8180-4cc0-a970-da551980148a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:41.600814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2081b995-8180-4cc0-a970-da551980148a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:41.601639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2081b995-8180-4cc0-a970-da551980148a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:41.602126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2081b995-8180-4cc0-a970-da551980148a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:41.682587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-978ab670-ac41-4f2d-9ed2-570410505ca6 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "DELETE /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 204 len: 0 microversion: 2.20 time: 0.215202 Dec 21 04:22:41.683304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 738/1437] 10.222.0.16 () {60 vars in 1270 bytes} [Mon Dec 21 04:22:41 2020] DELETE /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 21 04:22:41.698406 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-da4fbaa5-ae3e-4b56-a8e5-bd724e670cae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:41.699203 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-da4fbaa5-ae3e-4b56-a8e5-bd724e670cae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:41.707200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-da4fbaa5-ae3e-4b56-a8e5-bd724e670cae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:41.707711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-da4fbaa5-ae3e-4b56-a8e5-bd724e670cae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:41.708547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-da4fbaa5-ae3e-4b56-a8e5-bd724e670cae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:41.709085 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-da4fbaa5-ae3e-4b56-a8e5-bd724e670cae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:41.735483 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2081b995-8180-4cc0-a970-da551980148a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:41.745147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2081b995-8180-4cc0-a970-da551980148a tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.162542 Dec 21 04:22:41.745746 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 700/1438] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:41 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:41.934523 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-da4fbaa5-ae3e-4b56-a8e5-bd724e670cae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:41.952147 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-da4fbaa5-ae3e-4b56-a8e5-bd724e670cae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:41.958739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-da4fbaa5-ae3e-4b56-a8e5-bd724e670cae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:41.959985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-da4fbaa5-ae3e-4b56-a8e5-bd724e670cae tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 200 len: 1723 microversion: 2.20 time: 0.271456 Dec 21 04:22:41.960579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 739/1439] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:22:41 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:22:42.770211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1324ca39-2b8f-400a-b027-b2f94d080a9e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:42.770768 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1324ca39-2b8f-400a-b027-b2f94d080a9e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:42.779578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1324ca39-2b8f-400a-b027-b2f94d080a9e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:42.780134 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1324ca39-2b8f-400a-b027-b2f94d080a9e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:42.781024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1324ca39-2b8f-400a-b027-b2f94d080a9e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:42.781674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1324ca39-2b8f-400a-b027-b2f94d080a9e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:42.932537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1324ca39-2b8f-400a-b027-b2f94d080a9e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:42.942715 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1324ca39-2b8f-400a-b027-b2f94d080a9e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.182662 Dec 21 04:22:42.943559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 701/1440] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:42 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:42.985429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dc1b948e-36ba-4c3c-bbaa-85a434c8d742 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:42.986101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dc1b948e-36ba-4c3c-bbaa-85a434c8d742 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:42.994312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc1b948e-36ba-4c3c-bbaa-85a434c8d742 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:42.994820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc1b948e-36ba-4c3c-bbaa-85a434c8d742 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:42.995692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc1b948e-36ba-4c3c-bbaa-85a434c8d742 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:42.996183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc1b948e-36ba-4c3c-bbaa-85a434c8d742 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:43.133268 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dc1b948e-36ba-4c3c-bbaa-85a434c8d742 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:43.147818 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dc1b948e-36ba-4c3c-bbaa-85a434c8d742 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:43.154309 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dc1b948e-36ba-4c3c-bbaa-85a434c8d742 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:43.155537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dc1b948e-36ba-4c3c-bbaa-85a434c8d742 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 200 len: 1655 microversion: 2.20 time: 0.179365 Dec 21 04:22:43.167578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 740/1441] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:22:42 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 1655 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 21 04:22:43.845879 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-196979c3-fa3b-41c9-9efa-4d81e1ce5a22 req-670fb032-d561-472a-a18a-3850e41ebdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a45700-cf5d-492c-8293-19841bf629a4", "name": "network-vif-deleted", "tag": "56bbeacb-aa11-4389-9729-35e21814ae56"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:22:43.852651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:43.852651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:22:43.862293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-196979c3-fa3b-41c9-9efa-4d81e1ce5a22 req-670fb032-d561-472a-a18a-3850e41ebdc4 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:43.863076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-196979c3-fa3b-41c9-9efa-4d81e1ce5a22 req-670fb032-d561-472a-a18a-3850e41ebdc4 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:43.882018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-196979c3-fa3b-41c9-9efa-4d81e1ce5a22 req-670fb032-d561-472a-a18a-3850e41ebdc4 service nova] Creating event network-vif-deleted:56bbeacb-aa11-4389-9729-35e21814ae56 for instance b9a45700-cf5d-492c-8293-19841bf629a4 on hv-cinder-73306 Dec 21 04:22:43.886874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-196979c3-fa3b-41c9-9efa-4d81e1ce5a22 req-670fb032-d561-472a-a18a-3850e41ebdc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050913 Dec 21 04:22:43.887769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 702/1442] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:22:43 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:22:43.966700 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8980b677-14f9-4b1b-8637-33bd370a9007 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:43.967506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8980b677-14f9-4b1b-8637-33bd370a9007 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:43.976232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8980b677-14f9-4b1b-8637-33bd370a9007 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:43.977161 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8980b677-14f9-4b1b-8637-33bd370a9007 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:43.977746 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8980b677-14f9-4b1b-8637-33bd370a9007 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:43.978243 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8980b677-14f9-4b1b-8637-33bd370a9007 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:44.122013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8980b677-14f9-4b1b-8637-33bd370a9007 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:44.133214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8980b677-14f9-4b1b-8637-33bd370a9007 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.176172 Dec 21 04:22:44.133833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 741/1443] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:43 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:44.182425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:44.183335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:44.191600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:44.192193 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:44.193101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:44.193676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:44.275185 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:44.275699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:44.276208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lazy-loading 'fault' on Instance uuid b9a45700-cf5d-492c-8293-19841bf629a4 {{(pid=94298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:22:44.370857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:44.388812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:44.397355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d106173cd04d2e839770d14d8731a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8f76dafd9d4e19a9667dec5becb673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:44.399404 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0736c9c8-b7f0-422b-8292-7d8a17326f65 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 200 len: 1371 microversion: 2.20 time: 0.227497 Dec 21 04:22:44.400012 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 703/1444] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:22:44 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 21 04:22:45.156167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-efdab127-0784-4c26-9481-407bc987d6dd tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:45.156975 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-efdab127-0784-4c26-9481-407bc987d6dd tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:45.164944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efdab127-0784-4c26-9481-407bc987d6dd tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:45.165447 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efdab127-0784-4c26-9481-407bc987d6dd tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:45.166281 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efdab127-0784-4c26-9481-407bc987d6dd tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:45.166753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-efdab127-0784-4c26-9481-407bc987d6dd tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:45.299936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-efdab127-0784-4c26-9481-407bc987d6dd tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:45.309320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-efdab127-0784-4c26-9481-407bc987d6dd tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.162113 Dec 21 04:22:45.309850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 742/1445] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:45 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:45.425453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-16139f94-7f0f-4718-87af-3e6aa004bcf5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:45.426112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-16139f94-7f0f-4718-87af-3e6aa004bcf5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:45.433971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16139f94-7f0f-4718-87af-3e6aa004bcf5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:45.434471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16139f94-7f0f-4718-87af-3e6aa004bcf5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:45.435322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16139f94-7f0f-4718-87af-3e6aa004bcf5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:45.435810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-16139f94-7f0f-4718-87af-3e6aa004bcf5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:45.489061 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-16139f94-7f0f-4718-87af-3e6aa004bcf5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] HTTP exception thrown: Instance b9a45700-cf5d-492c-8293-19841bf629a4 could not be found. Dec 21 04:22:45.489727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-16139f94-7f0f-4718-87af-3e6aa004bcf5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Returning 404 to user: Instance b9a45700-cf5d-492c-8293-19841bf629a4 could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:22:45.490625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-16139f94-7f0f-4718-87af-3e6aa004bcf5 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 404 len: 111 microversion: 2.20 time: 0.074823 Dec 21 04:22:45.491273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 704/1446] 10.222.0.16 () {60 vars in 1267 bytes} [Mon Dec 21 04:22:45 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 21 04:22:45.506088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-23af6e5c-e987-461d-afad-273b90782e50 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '.version_select at 0x7f2bb85a9a60>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:45.532817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-23af6e5c-e987-461d-afad-273b90782e50 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-606155027" status: 204 len: 0 microversion: 2.20 time: 0.036492 Dec 21 04:22:45.533439 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 743/1447] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Dec 21 04:22:45 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-606155027 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 21 04:22:46.333603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dc3f2540-2b35-4bc5-a599-695d1a148489 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:46.334272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dc3f2540-2b35-4bc5-a599-695d1a148489 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:46.342148 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc3f2540-2b35-4bc5-a599-695d1a148489 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:46.342659 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc3f2540-2b35-4bc5-a599-695d1a148489 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:46.344122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc3f2540-2b35-4bc5-a599-695d1a148489 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:46.344710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc3f2540-2b35-4bc5-a599-695d1a148489 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:46.505993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dc3f2540-2b35-4bc5-a599-695d1a148489 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:46.515985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dc3f2540-2b35-4bc5-a599-695d1a148489 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.191540 Dec 21 04:22:46.516579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 705/1448] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:46 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:47.539320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d533728f-3361-4e9a-8e94-45f550606323 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:47.539988 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d533728f-3361-4e9a-8e94-45f550606323 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:47.548470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d533728f-3361-4e9a-8e94-45f550606323 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:47.548976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d533728f-3361-4e9a-8e94-45f550606323 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:47.549806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d533728f-3361-4e9a-8e94-45f550606323 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:47.550297 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d533728f-3361-4e9a-8e94-45f550606323 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:47.683149 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d533728f-3361-4e9a-8e94-45f550606323 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:47.692778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d533728f-3361-4e9a-8e94-45f550606323 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.163381 Dec 21 04:22:47.693377 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 744/1449] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:47 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:48.715977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-aa2b8e71-5cd9-46a0-b47d-75009f992dff tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:48.716645 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-aa2b8e71-5cd9-46a0-b47d-75009f992dff tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:48.724734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aa2b8e71-5cd9-46a0-b47d-75009f992dff tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:48.725240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aa2b8e71-5cd9-46a0-b47d-75009f992dff tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:48.726063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aa2b8e71-5cd9-46a0-b47d-75009f992dff tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:48.726548 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-aa2b8e71-5cd9-46a0-b47d-75009f992dff tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:48.858469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-aa2b8e71-5cd9-46a0-b47d-75009f992dff tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:48.868710 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-aa2b8e71-5cd9-46a0-b47d-75009f992dff tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.161678 Dec 21 04:22:48.869299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 706/1450] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:48 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:49.892419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-87fdc1f3-8109-4ac0-b7fe-2dad10a1f4ba tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:49.893208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-87fdc1f3-8109-4ac0-b7fe-2dad10a1f4ba tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:49.901196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87fdc1f3-8109-4ac0-b7fe-2dad10a1f4ba tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:49.901711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87fdc1f3-8109-4ac0-b7fe-2dad10a1f4ba tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:49.902553 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87fdc1f3-8109-4ac0-b7fe-2dad10a1f4ba tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:49.903082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-87fdc1f3-8109-4ac0-b7fe-2dad10a1f4ba tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:50.039829 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-87fdc1f3-8109-4ac0-b7fe-2dad10a1f4ba tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:50.050073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-87fdc1f3-8109-4ac0-b7fe-2dad10a1f4ba tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.167360 Dec 21 04:22:50.050707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 745/1451] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:49 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:51.072844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d6d3b085-b921-4eb8-9d85-1fc770922a6d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:51.073511 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d6d3b085-b921-4eb8-9d85-1fc770922a6d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:51.081954 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d6d3b085-b921-4eb8-9d85-1fc770922a6d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:51.082453 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d6d3b085-b921-4eb8-9d85-1fc770922a6d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:51.083318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d6d3b085-b921-4eb8-9d85-1fc770922a6d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:51.083805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d6d3b085-b921-4eb8-9d85-1fc770922a6d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:51.217022 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d6d3b085-b921-4eb8-9d85-1fc770922a6d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:51.227186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d6d3b085-b921-4eb8-9d85-1fc770922a6d tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.163290 Dec 21 04:22:51.227815 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 707/1452] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:51 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:52.250810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-659d01b8-e746-4aa2-a299-b7ee2227dcad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:52.251540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-659d01b8-e746-4aa2-a299-b7ee2227dcad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:52.259953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-659d01b8-e746-4aa2-a299-b7ee2227dcad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:52.260459 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-659d01b8-e746-4aa2-a299-b7ee2227dcad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:52.261293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-659d01b8-e746-4aa2-a299-b7ee2227dcad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:52.261784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-659d01b8-e746-4aa2-a299-b7ee2227dcad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:52.393886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-659d01b8-e746-4aa2-a299-b7ee2227dcad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:52.403283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-659d01b8-e746-4aa2-a299-b7ee2227dcad tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.162066 Dec 21 04:22:52.403881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 746/1453] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:52 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:53.427400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ebb0de71-1610-40b2-bc09-304ee545bc89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:53.428006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ebb0de71-1610-40b2-bc09-304ee545bc89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:53.435835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebb0de71-1610-40b2-bc09-304ee545bc89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:53.436347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebb0de71-1610-40b2-bc09-304ee545bc89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:53.437191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebb0de71-1610-40b2-bc09-304ee545bc89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:53.437681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebb0de71-1610-40b2-bc09-304ee545bc89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:53.586117 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ebb0de71-1610-40b2-bc09-304ee545bc89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:53.596394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ebb0de71-1610-40b2-bc09-304ee545bc89 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.178536 Dec 21 04:22:53.596985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 708/1454] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:53 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:54.619938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-984e9209-859e-4d21-b4af-84c28c97e0d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:54.620606 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-984e9209-859e-4d21-b4af-84c28c97e0d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:54.629071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-984e9209-859e-4d21-b4af-84c28c97e0d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:54.629576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-984e9209-859e-4d21-b4af-84c28c97e0d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:54.630410 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-984e9209-859e-4d21-b4af-84c28c97e0d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:54.630919 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-984e9209-859e-4d21-b4af-84c28c97e0d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:54.766042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-984e9209-859e-4d21-b4af-84c28c97e0d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:54.775538 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-984e9209-859e-4d21-b4af-84c28c97e0d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.165803 Dec 21 04:22:54.776131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 747/1455] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:54 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:55.798607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ebf92333-5cf0-4948-92dd-440ad079ae1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:55.799298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ebf92333-5cf0-4948-92dd-440ad079ae1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:55.807133 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebf92333-5cf0-4948-92dd-440ad079ae1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:55.807641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebf92333-5cf0-4948-92dd-440ad079ae1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:55.808474 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebf92333-5cf0-4948-92dd-440ad079ae1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:55.808964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ebf92333-5cf0-4948-92dd-440ad079ae1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:55.939460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ebf92333-5cf0-4948-92dd-440ad079ae1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:55.948784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ebf92333-5cf0-4948-92dd-440ad079ae1c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.159208 Dec 21 04:22:55.949374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 709/1456] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:55 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:56.973104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d0e0ca57-9028-410a-a8ed-55b5c6eb8af9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:56.973784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d0e0ca57-9028-410a-a8ed-55b5c6eb8af9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:56.981753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d0e0ca57-9028-410a-a8ed-55b5c6eb8af9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:56.982266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d0e0ca57-9028-410a-a8ed-55b5c6eb8af9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:56.983138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d0e0ca57-9028-410a-a8ed-55b5c6eb8af9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:56.983639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d0e0ca57-9028-410a-a8ed-55b5c6eb8af9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:57.117421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d0e0ca57-9028-410a-a8ed-55b5c6eb8af9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:57.126843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d0e0ca57-9028-410a-a8ed-55b5c6eb8af9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.163965 Dec 21 04:22:57.127471 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 748/1457] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:56 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:58.150015 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-58424d4a-98da-4a1d-8d43-e861db188e85 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:58.150675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-58424d4a-98da-4a1d-8d43-e861db188e85 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:58.159358 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58424d4a-98da-4a1d-8d43-e861db188e85 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:58.159868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58424d4a-98da-4a1d-8d43-e861db188e85 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:58.160704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58424d4a-98da-4a1d-8d43-e861db188e85 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:58.161201 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58424d4a-98da-4a1d-8d43-e861db188e85 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:58.295308 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-58424d4a-98da-4a1d-8d43-e861db188e85 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:58.305850 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-58424d4a-98da-4a1d-8d43-e861db188e85 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.164980 Dec 21 04:22:58.306676 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 710/1458] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:58 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:22:59.329164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ef1b4c0b-663e-49dc-b27d-ac44553616e7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:22:59.329836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ef1b4c0b-663e-49dc-b27d-ac44553616e7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:22:59.337747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef1b4c0b-663e-49dc-b27d-ac44553616e7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:59.338253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef1b4c0b-663e-49dc-b27d-ac44553616e7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:59.339142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef1b4c0b-663e-49dc-b27d-ac44553616e7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:22:59.339689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ef1b4c0b-663e-49dc-b27d-ac44553616e7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:22:59.470683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ef1b4c0b-663e-49dc-b27d-ac44553616e7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:22:59.480440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ef1b4c0b-663e-49dc-b27d-ac44553616e7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.160460 Dec 21 04:22:59.481414 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 749/1459] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:22:59 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:00.505211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5d260822-5e75-43d5-b942-fe0fb00fbfa4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:00.505873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5d260822-5e75-43d5-b942-fe0fb00fbfa4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:00.513902 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d260822-5e75-43d5-b942-fe0fb00fbfa4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:00.514405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d260822-5e75-43d5-b942-fe0fb00fbfa4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:00.515312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d260822-5e75-43d5-b942-fe0fb00fbfa4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:00.515802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d260822-5e75-43d5-b942-fe0fb00fbfa4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:00.649924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5d260822-5e75-43d5-b942-fe0fb00fbfa4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:00.659481 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5d260822-5e75-43d5-b942-fe0fb00fbfa4 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.164208 Dec 21 04:23:00.660072 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 711/1460] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:00 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:01.683461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dad0df2c-c466-4085-b3f0-c29621004f3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:01.684119 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dad0df2c-c466-4085-b3f0-c29621004f3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:01.692146 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dad0df2c-c466-4085-b3f0-c29621004f3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:01.692664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dad0df2c-c466-4085-b3f0-c29621004f3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:01.693554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dad0df2c-c466-4085-b3f0-c29621004f3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:01.694058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dad0df2c-c466-4085-b3f0-c29621004f3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:01.826570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dad0df2c-c466-4085-b3f0-c29621004f3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:01.836672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dad0df2c-c466-4085-b3f0-c29621004f3b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.163218 Dec 21 04:23:01.837264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 750/1461] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:01 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:02.860949 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1472651a-a6ba-499a-827a-d7c6b0d239f3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:02.861599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1472651a-a6ba-499a-827a-d7c6b0d239f3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:02.869907 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1472651a-a6ba-499a-827a-d7c6b0d239f3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:02.870408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1472651a-a6ba-499a-827a-d7c6b0d239f3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:02.871266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1472651a-a6ba-499a-827a-d7c6b0d239f3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:02.871753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1472651a-a6ba-499a-827a-d7c6b0d239f3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:03.002881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1472651a-a6ba-499a-827a-d7c6b0d239f3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:03.012126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1472651a-a6ba-499a-827a-d7c6b0d239f3 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.160806 Dec 21 04:23:03.012716 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 712/1462] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:02 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:04.039681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-51eaa1f2-157c-4bfe-9826-483f4f3e61d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:04.040355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-51eaa1f2-157c-4bfe-9826-483f4f3e61d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:04.048314 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-51eaa1f2-157c-4bfe-9826-483f4f3e61d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:04.048820 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-51eaa1f2-157c-4bfe-9826-483f4f3e61d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:04.049695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-51eaa1f2-157c-4bfe-9826-483f4f3e61d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:04.050142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-51eaa1f2-157c-4bfe-9826-483f4f3e61d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:04.182273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-51eaa1f2-157c-4bfe-9826-483f4f3e61d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:04.192423 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-51eaa1f2-157c-4bfe-9826-483f4f3e61d7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.161994 Dec 21 04:23:04.193020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 751/1463] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:04 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:05.215673 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-34c8cac5-29d0-4a4b-a76f-5181535e11c5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:05.216244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-34c8cac5-29d0-4a4b-a76f-5181535e11c5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:05.224884 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34c8cac5-29d0-4a4b-a76f-5181535e11c5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:05.225393 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34c8cac5-29d0-4a4b-a76f-5181535e11c5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:05.226545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34c8cac5-29d0-4a4b-a76f-5181535e11c5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:05.226762 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-34c8cac5-29d0-4a4b-a76f-5181535e11c5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:05.361062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-34c8cac5-29d0-4a4b-a76f-5181535e11c5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:05.370779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-34c8cac5-29d0-4a4b-a76f-5181535e11c5 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.164194 Dec 21 04:23:05.371416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 713/1464] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:05 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:06.394479 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-568cb90d-680c-44e6-a7db-90d52b26ce5f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:06.395195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-568cb90d-680c-44e6-a7db-90d52b26ce5f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:06.403036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-568cb90d-680c-44e6-a7db-90d52b26ce5f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:06.403547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-568cb90d-680c-44e6-a7db-90d52b26ce5f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:06.404385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-568cb90d-680c-44e6-a7db-90d52b26ce5f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:06.404874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-568cb90d-680c-44e6-a7db-90d52b26ce5f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:06.536151 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-568cb90d-680c-44e6-a7db-90d52b26ce5f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:06.545539 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-568cb90d-680c-44e6-a7db-90d52b26ce5f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.160255 Dec 21 04:23:06.546127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 752/1465] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:06 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:07.569989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-077f3f5a-cdda-4e74-ac21-97fe4e5a5d12 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:07.570660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-077f3f5a-cdda-4e74-ac21-97fe4e5a5d12 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:07.578506 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-077f3f5a-cdda-4e74-ac21-97fe4e5a5d12 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:07.579064 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-077f3f5a-cdda-4e74-ac21-97fe4e5a5d12 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:07.580005 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-077f3f5a-cdda-4e74-ac21-97fe4e5a5d12 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:07.580515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-077f3f5a-cdda-4e74-ac21-97fe4e5a5d12 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:07.718647 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-077f3f5a-cdda-4e74-ac21-97fe4e5a5d12 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:07.723898 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-077f3f5a-cdda-4e74-ac21-97fe4e5a5d12 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.163671 Dec 21 04:23:07.724674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 714/1466] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:07 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:08.749002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-88874399-ed29-49f1-baf6-7a274219efe7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:08.749605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-88874399-ed29-49f1-baf6-7a274219efe7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:08.758244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88874399-ed29-49f1-baf6-7a274219efe7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:08.758747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88874399-ed29-49f1-baf6-7a274219efe7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:08.759666 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88874399-ed29-49f1-baf6-7a274219efe7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:08.760159 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-88874399-ed29-49f1-baf6-7a274219efe7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:08.893881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-88874399-ed29-49f1-baf6-7a274219efe7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:08.903775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-88874399-ed29-49f1-baf6-7a274219efe7 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.164229 Dec 21 04:23:08.904378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 753/1467] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:08 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:09.926974 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5406a492-4876-4f2b-ac4a-bbdf834bf83f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:09.927683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5406a492-4876-4f2b-ac4a-bbdf834bf83f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:09.935508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5406a492-4876-4f2b-ac4a-bbdf834bf83f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:09.936016 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5406a492-4876-4f2b-ac4a-bbdf834bf83f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:09.936855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5406a492-4876-4f2b-ac4a-bbdf834bf83f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:09.937349 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5406a492-4876-4f2b-ac4a-bbdf834bf83f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:10.069390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5406a492-4876-4f2b-ac4a-bbdf834bf83f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:10.079389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5406a492-4876-4f2b-ac4a-bbdf834bf83f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.161509 Dec 21 04:23:10.079975 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 715/1468] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:09 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:11.102141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e70eedbd-54b4-4af5-99dc-2c0172ee358e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:11.102808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e70eedbd-54b4-4af5-99dc-2c0172ee358e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:11.111313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e70eedbd-54b4-4af5-99dc-2c0172ee358e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:11.111814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e70eedbd-54b4-4af5-99dc-2c0172ee358e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:11.112639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e70eedbd-54b4-4af5-99dc-2c0172ee358e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:11.113128 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e70eedbd-54b4-4af5-99dc-2c0172ee358e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:11.247487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e70eedbd-54b4-4af5-99dc-2c0172ee358e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:11.257937 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e70eedbd-54b4-4af5-99dc-2c0172ee358e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.164818 Dec 21 04:23:11.258537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 754/1469] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:11 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:12.281089 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-144a8c41-efe2-4c7a-acbc-c1376bce077f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:12.281782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-144a8c41-efe2-4c7a-acbc-c1376bce077f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:12.289617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-144a8c41-efe2-4c7a-acbc-c1376bce077f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:12.290129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-144a8c41-efe2-4c7a-acbc-c1376bce077f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:12.290979 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-144a8c41-efe2-4c7a-acbc-c1376bce077f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:12.291475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-144a8c41-efe2-4c7a-acbc-c1376bce077f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:12.422489 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-144a8c41-efe2-4c7a-acbc-c1376bce077f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:12.431752 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-144a8c41-efe2-4c7a-acbc-c1376bce077f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.159798 Dec 21 04:23:12.432331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 716/1470] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:12 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:13.456427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-93130577-3846-43c4-9db1-c7a8e81f9164 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:13.457025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-93130577-3846-43c4-9db1-c7a8e81f9164 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:13.465038 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93130577-3846-43c4-9db1-c7a8e81f9164 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:13.465543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93130577-3846-43c4-9db1-c7a8e81f9164 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:13.466379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93130577-3846-43c4-9db1-c7a8e81f9164 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:13.466865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-93130577-3846-43c4-9db1-c7a8e81f9164 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:13.598522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-93130577-3846-43c4-9db1-c7a8e81f9164 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:13.607801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-93130577-3846-43c4-9db1-c7a8e81f9164 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.161420 Dec 21 04:23:13.608392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 755/1471] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:13 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:14.631063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-50e38c68-1af4-4d7b-abf6-2f47f016eca9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:14.631661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-50e38c68-1af4-4d7b-abf6-2f47f016eca9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:14.639440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50e38c68-1af4-4d7b-abf6-2f47f016eca9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:14.639941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50e38c68-1af4-4d7b-abf6-2f47f016eca9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:14.640760 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50e38c68-1af4-4d7b-abf6-2f47f016eca9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:14.641247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-50e38c68-1af4-4d7b-abf6-2f47f016eca9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:14.773614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-50e38c68-1af4-4d7b-abf6-2f47f016eca9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:14.783653 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-50e38c68-1af4-4d7b-abf6-2f47f016eca9 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.161743 Dec 21 04:23:14.784251 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 717/1472] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:14 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:15.807350 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-73230284-345a-4608-8fba-e389c1dd282f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:15.808017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-73230284-345a-4608-8fba-e389c1dd282f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:15.816660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73230284-345a-4608-8fba-e389c1dd282f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:15.817166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73230284-345a-4608-8fba-e389c1dd282f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:15.817986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73230284-345a-4608-8fba-e389c1dd282f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:15.818475 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73230284-345a-4608-8fba-e389c1dd282f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:15.950869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-73230284-345a-4608-8fba-e389c1dd282f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:15.960420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-73230284-345a-4608-8fba-e389c1dd282f tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.162207 Dec 21 04:23:15.961007 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 756/1473] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:15 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:23:16.984582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8e3c0a2e-0909-44ee-ae64-050686b5476c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:16.985248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8e3c0a2e-0909-44ee-ae64-050686b5476c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:16.993633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e3c0a2e-0909-44ee-ae64-050686b5476c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:16.994140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e3c0a2e-0909-44ee-ae64-050686b5476c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:16.994971 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e3c0a2e-0909-44ee-ae64-050686b5476c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:16.995464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8e3c0a2e-0909-44ee-ae64-050686b5476c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:17.127098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8e3c0a2e-0909-44ee-ae64-050686b5476c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:17.136433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8e3c0a2e-0909-44ee-ae64-050686b5476c tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.160942 Dec 21 04:23:17.137024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 718/1474] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:16 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:18.159573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-30661e5f-73a0-4588-9754-8107f6b06763 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:18.160238 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-30661e5f-73a0-4588-9754-8107f6b06763 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:18.168186 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30661e5f-73a0-4588-9754-8107f6b06763 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:18.168693 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30661e5f-73a0-4588-9754-8107f6b06763 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:18.169527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30661e5f-73a0-4588-9754-8107f6b06763 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:18.170020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-30661e5f-73a0-4588-9754-8107f6b06763 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:18.305946 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-30661e5f-73a0-4588-9754-8107f6b06763 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:18.315322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-30661e5f-73a0-4588-9754-8107f6b06763 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.165134 Dec 21 04:23:18.315915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 757/1475] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:18 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:19.338795 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-66967ae0-a5a2-4f27-9887-b25049fa85d2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:19.339521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-66967ae0-a5a2-4f27-9887-b25049fa85d2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:19.347614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-66967ae0-a5a2-4f27-9887-b25049fa85d2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:19.348120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-66967ae0-a5a2-4f27-9887-b25049fa85d2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:19.348947 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-66967ae0-a5a2-4f27-9887-b25049fa85d2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:19.349435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-66967ae0-a5a2-4f27-9887-b25049fa85d2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:19.481198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-66967ae0-a5a2-4f27-9887-b25049fa85d2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:19.491362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-66967ae0-a5a2-4f27-9887-b25049fa85d2 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.162148 Dec 21 04:23:19.500129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 719/1476] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:19 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:20.515993 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5d1b6d6c-f349-443e-9218-cbfe4561c722 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:20.517256 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5d1b6d6c-f349-443e-9218-cbfe4561c722 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:20.525124 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d1b6d6c-f349-443e-9218-cbfe4561c722 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:20.525631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d1b6d6c-f349-443e-9218-cbfe4561c722 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:20.526452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d1b6d6c-f349-443e-9218-cbfe4561c722 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:20.526963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5d1b6d6c-f349-443e-9218-cbfe4561c722 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:20.657952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5d1b6d6c-f349-443e-9218-cbfe4561c722 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:20.667403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5d1b6d6c-f349-443e-9218-cbfe4561c722 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.160864 Dec 21 04:23:20.667982 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 758/1477] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:20 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:21.690674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e92c1894-c51c-4e18-b60a-ebc1eba0dc39 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:21.691369 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e92c1894-c51c-4e18-b60a-ebc1eba0dc39 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:21.699236 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e92c1894-c51c-4e18-b60a-ebc1eba0dc39 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:21.699757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e92c1894-c51c-4e18-b60a-ebc1eba0dc39 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:21.700601 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e92c1894-c51c-4e18-b60a-ebc1eba0dc39 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:21.701094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e92c1894-c51c-4e18-b60a-ebc1eba0dc39 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:21.834999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e92c1894-c51c-4e18-b60a-ebc1eba0dc39 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:21.845205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e92c1894-c51c-4e18-b60a-ebc1eba0dc39 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.163018 Dec 21 04:23:21.845806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 720/1478] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:21 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:22.869719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a4c5368a-5e59-4669-b0f7-f1fd7e71ad0b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:22.870390 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a4c5368a-5e59-4669-b0f7-f1fd7e71ad0b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:22.878631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4c5368a-5e59-4669-b0f7-f1fd7e71ad0b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:22.879168 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4c5368a-5e59-4669-b0f7-f1fd7e71ad0b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:22.879992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4c5368a-5e59-4669-b0f7-f1fd7e71ad0b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:22.880482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4c5368a-5e59-4669-b0f7-f1fd7e71ad0b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:23.019440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a4c5368a-5e59-4669-b0f7-f1fd7e71ad0b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:23.028925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a4c5368a-5e59-4669-b0f7-f1fd7e71ad0b tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.169632 Dec 21 04:23:23.029527 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 759/1479] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:22 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:24.052876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1d83b7b6-728e-43ad-ad19-73024b543d15 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:24.053537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1d83b7b6-728e-43ad-ad19-73024b543d15 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:24.061497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1d83b7b6-728e-43ad-ad19-73024b543d15 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:24.062002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1d83b7b6-728e-43ad-ad19-73024b543d15 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:24.062831 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1d83b7b6-728e-43ad-ad19-73024b543d15 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:24.063552 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1d83b7b6-728e-43ad-ad19-73024b543d15 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:24.195123 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1d83b7b6-728e-43ad-ad19-73024b543d15 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:24.205425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1d83b7b6-728e-43ad-ad19-73024b543d15 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1390 microversion: 2.1 time: 0.161997 Dec 21 04:23:24.206030 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 721/1480] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:24 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:25.229596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0ae9f417-e2f7-4129-80dd-62d6285a674e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:25.230272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0ae9f417-e2f7-4129-80dd-62d6285a674e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:25.238770 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ae9f417-e2f7-4129-80dd-62d6285a674e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:25.239315 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ae9f417-e2f7-4129-80dd-62d6285a674e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:25.240264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ae9f417-e2f7-4129-80dd-62d6285a674e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:25.240763 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ae9f417-e2f7-4129-80dd-62d6285a674e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:25.323094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ae9f417-e2f7-4129-80dd-62d6285a674e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:25.323617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ae9f417-e2f7-4129-80dd-62d6285a674e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:25.324138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-0ae9f417-e2f7-4129-80dd-62d6285a674e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lazy-loading 'fault' on Instance uuid daa828a0-c810-48fe-8ea0-866c312aeb98 {{(pid=94299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:23:25.394952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0ae9f417-e2f7-4129-80dd-62d6285a674e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae86a8c255940a8b6352ee2b9e1e8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854b1b3076d4532ac6b8813b4df1ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:23:25.404484 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0ae9f417-e2f7-4129-80dd-62d6285a674e tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 200 len: 1484 microversion: 2.1 time: 0.184203 Dec 21 04:23:25.405075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 760/1481] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:25 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 1484 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:23:26.428065 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-875406b7-86e4-4f46-a410-e5ca4289df29 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:26.428726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-875406b7-86e4-4f46-a410-e5ca4289df29 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] [instance: daa828a0-c810-48fe-8ea0-866c312aeb98] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:23:26.436460 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-875406b7-86e4-4f46-a410-e5ca4289df29 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:26.436968 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-875406b7-86e4-4f46-a410-e5ca4289df29 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:26.437798 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-875406b7-86e4-4f46-a410-e5ca4289df29 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:23:26.438582 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-875406b7-86e4-4f46-a410-e5ca4289df29 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:23:26.492966 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-875406b7-86e4-4f46-a410-e5ca4289df29 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] HTTP exception thrown: Instance daa828a0-c810-48fe-8ea0-866c312aeb98 could not be found. Dec 21 04:23:26.493634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-875406b7-86e4-4f46-a410-e5ca4289df29 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Returning 404 to user: Instance daa828a0-c810-48fe-8ea0-866c312aeb98 could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:23:26.494505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-875406b7-86e4-4f46-a410-e5ca4289df29 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98" status: 404 len: 111 microversion: 2.1 time: 0.075455 Dec 21 04:23:26.495331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 722/1482] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:23:26 2020] GET /compute/v2.1/servers/daa828a0-c810-48fe-8ea0-866c312aeb98 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:23:26.509774 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c7e52735-d657-4504-9356-6575e3fd1429 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] Calling method '.version_select at 0x7f2bb842a400>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:23:26.532319 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c7e52735-d657-4504-9356-6575e3fd1429 tempest-TestMinimumBasicScenario-2065912205 tempest-TestMinimumBasicScenario-2065912205] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1283495731" status: 202 len: 0 microversion: 2.1 time: 0.032339 Dec 21 04:23:26.532938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 761/1483] 10.222.0.16 () {58 vars in 1262 bytes} [Mon Dec 21 04:23:26 2020] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1283495731 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:23:46.133668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:23:46.134158 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:23:46 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:25:27.270906 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:25:27.271413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:25:27 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:25:46.069143 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:25:46.069617 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:25:46 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:25:54.704728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:25:54.705247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:25:54 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:25:56.995766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:25:56.996263 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:25:56 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:27:06.150841 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:27:06.151370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:27:06 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:28:20.880424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27fe5106-18ea-44c6-8644-655b910d6119] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 21 04:28:20.889625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8ff9a29f-61aa-47f7-8274-53cc34795eab tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:28:20.890166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8ff9a29f-61aa-47f7-8274-53cc34795eab tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:28:20.898047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8ff9a29f-61aa-47f7-8274-53cc34795eab tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:28:20.898551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8ff9a29f-61aa-47f7-8274-53cc34795eab tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:28:20.899434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8ff9a29f-61aa-47f7-8274-53cc34795eab tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:28:20.899924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8ff9a29f-61aa-47f7-8274-53cc34795eab tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:28:20.955040 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-8ff9a29f-61aa-47f7-8274-53cc34795eab tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] HTTP exception thrown: Instance 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c could not be found. Dec 21 04:28:20.955686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8ff9a29f-61aa-47f7-8274-53cc34795eab tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Returning 404 to user: Instance 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:28:20.956560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8ff9a29f-61aa-47f7-8274-53cc34795eab tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "DELETE /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 404 len: 111 microversion: 2.1 time: 0.077703 Dec 21 04:28:20.957137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 723/1484] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:28:20 2020] DELETE /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:28:20.963952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dca63194-cb64-420f-b69a-f6c254fed282] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 21 04:28:20.973219 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4e5c7ba2-c8a8-460b-91c2-543b1c2dbdad tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:28:20.973888 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4e5c7ba2-c8a8-460b-91c2-543b1c2dbdad tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] [instance: 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:28:20.981728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e5c7ba2-c8a8-460b-91c2-543b1c2dbdad tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:28:20.982241 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e5c7ba2-c8a8-460b-91c2-543b1c2dbdad tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:28:20.983100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e5c7ba2-c8a8-460b-91c2-543b1c2dbdad tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:28:20.983598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4e5c7ba2-c8a8-460b-91c2-543b1c2dbdad tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:28:21.036510 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-4e5c7ba2-c8a8-460b-91c2-543b1c2dbdad tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] HTTP exception thrown: Instance 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c could not be found. Dec 21 04:28:21.037223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4e5c7ba2-c8a8-460b-91c2-543b1c2dbdad tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] Returning 404 to user: Instance 3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:28:21.038058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4e5c7ba2-c8a8-460b-91c2-543b1c2dbdad tempest-AttachVolumeTestJSON-519564155 tempest-AttachVolumeTestJSON-519564155] 10.222.0.16 "GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c" status: 404 len: 111 microversion: 2.1 time: 0.076506 Dec 21 04:28:21.038650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 762/1485] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:28:20 2020] GET /compute/v2.1/servers/3279a9ba-d6ae-4d7c-bf86-3b2d9da5076c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:28:29.663656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] [27fe5106-18ea-44c6-8644-655b910d6119] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37236. Dec 21 04:28:29.813876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c562583f-b28b-41e2-b989-7dddd26beae1 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] Action: 'create', calling method: .version_select at 0x7f2bbd28f048>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1534451550", "metadata": {"Type": "work"}}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:28:29.815521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c562583f-b28b-41e2-b989-7dddd26beae1 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:28:29.816385 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c562583f-b28b-41e2-b989-7dddd26beae1 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.175277 Dec 21 04:28:29.816962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 724/1486] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Dec 21 04:28:29 2020] POST /compute/v2.1/os-volumes => generated 127 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 21 04:28:29.832296 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-840d9b79-17ef-451c-8ffd-b096e00b8cfc tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] Action: 'create', calling method: .version_select at 0x7f2bb842a400>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1483277933", "metadata": {"Type": "work"}}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:28:29.833849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-840d9b79-17ef-451c-8ffd-b096e00b8cfc tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:28:29.834753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-840d9b79-17ef-451c-8ffd-b096e00b8cfc tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012275 Dec 21 04:28:29.835359 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 763/1487] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Dec 21 04:28:29 2020] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 21 04:28:29.849551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-aecdb99f-885b-4748-b992-7aa7d7cee2ec tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] Action: 'create', calling method: .version_select at 0x7f2bb8744ea0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1259283274", "metadata": {"Type": "work"}}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:28:29.851429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-aecdb99f-885b-4748-b992-7aa7d7cee2ec tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:28:29.852295 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-aecdb99f-885b-4748-b992-7aa7d7cee2ec tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011843 Dec 21 04:28:29.852855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 725/1488] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Dec 21 04:28:29 2020] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 21 04:28:29.879629 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a2be92f1-ae13-4d51-b0de-7b3b3857e73d tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] Calling method '.version_select at 0x7f2bb84ef268>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:28:29.898723 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] [dca63194-cb64-420f-b69a-f6c254fed282] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37244. Dec 21 04:28:30.091633 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-a2be92f1-ae13-4d51-b0de-7b3b3857e73d tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] HTTP exception thrown: Volume tempest-invalid-1699291973 could not be found. Dec 21 04:28:30.092307 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a2be92f1-ae13-4d51-b0de-7b3b3857e73d tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] Returning 404 to user: Volume tempest-invalid-1699291973 could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:28:30.093246 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a2be92f1-ae13-4d51-b0de-7b3b3857e73d tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1699291973" status: 404 len: 99 microversion: 2.1 time: 0.235378 Dec 21 04:28:30.093847 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 764/1489] 10.222.0.16 () {58 vars in 1208 bytes} [Mon Dec 21 04:28:29 2020] DELETE /compute/v2.1/os-volumes/tempest-invalid-1699291973 => generated 99 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 21 04:28:30.109327 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-22a10cdc-3f9e-45a8-9b4f-736a78e18f76 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009111 Dec 21 04:28:30.109912 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 726/1490] 10.222.0.16 () {58 vars in 1130 bytes} [Mon Dec 21 04:28:30 2020] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 21 04:28:30.124391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-afff0dad-ca67-4946-b7e9-db7755c72303 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009130 Dec 21 04:28:30.124923 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 765/1491] 10.222.0.16 () {58 vars in 1127 bytes} [Mon Dec 21 04:28:30 2020] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 21 04:28:30.138695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-28307350-f073-40bc-bbb7-9f9097bfc220 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] Calling method '.version_select at 0x7f2bb90d9c80>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:28:30.286821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-28307350-f073-40bc-bbb7-9f9097bfc220 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] HTTP exception thrown: Volume a7eb99cb-e92e-4244-a533-62f053c71dd2 could not be found. Dec 21 04:28:30.288952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-28307350-f073-40bc-bbb7-9f9097bfc220 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] Returning 404 to user: Volume a7eb99cb-e92e-4244-a533-62f053c71dd2 could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:28:30.288952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-28307350-f073-40bc-bbb7-9f9097bfc220 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/a7eb99cb-e92e-4244-a533-62f053c71dd2" status: 404 len: 109 microversion: 2.1 time: 0.158447 Dec 21 04:28:30.288952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 727/1492] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Dec 21 04:28:30 2020] DELETE /compute/v2.1/os-volumes/a7eb99cb-e92e-4244-a533-62f053c71dd2 => generated 109 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:28:30.304855 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-aee38253-66a2-4bab-a296-2945b270ed93 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] Calling method '.version_select at 0x7f2bb842abf8>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:28:30.373595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-aee38253-66a2-4bab-a296-2945b270ed93 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] HTTP exception thrown: Volume 45159d4c-c015-4379-9078-a1ea13a81830 could not be found. Dec 21 04:28:30.374280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-aee38253-66a2-4bab-a296-2945b270ed93 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] Returning 404 to user: Volume 45159d4c-c015-4379-9078-a1ea13a81830 could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:28:30.375221 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-aee38253-66a2-4bab-a296-2945b270ed93 tempest-VolumesNegativeTest-537856475 tempest-VolumesNegativeTest-537856475] 10.222.0.16 "GET /compute/v2.1/os-volumes/45159d4c-c015-4379-9078-a1ea13a81830" status: 404 len: 109 microversion: 2.1 time: 0.080209 Dec 21 04:28:30.376271 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 766/1493] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Dec 21 04:28:30 2020] GET /compute/v2.1/os-volumes/45159d4c-c015-4379-9078-a1ea13a81830 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:28:46.058425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2bdd55ba-6bac-4951-b789-8d4722e00ff2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:28:46.059009 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2bdd55ba-6bac-4951-b789-8d4722e00ff2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:28:46.068325 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bdd55ba-6bac-4951-b789-8d4722e00ff2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:28:46.068838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bdd55ba-6bac-4951-b789-8d4722e00ff2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:28:46.069725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bdd55ba-6bac-4951-b789-8d4722e00ff2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:28:46.070272 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2bdd55ba-6bac-4951-b789-8d4722e00ff2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:28:46.123631 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-2bdd55ba-6bac-4951-b789-8d4722e00ff2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] HTTP exception thrown: Instance b9a45700-cf5d-492c-8293-19841bf629a4 could not be found. Dec 21 04:28:46.124303 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2bdd55ba-6bac-4951-b789-8d4722e00ff2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Returning 404 to user: Instance b9a45700-cf5d-492c-8293-19841bf629a4 could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:28:46.125252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2bdd55ba-6bac-4951-b789-8d4722e00ff2 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "DELETE /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 404 len: 111 microversion: 2.1 time: 0.076741 Dec 21 04:28:46.126080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 728/1494] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:28:46 2020] DELETE /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:28:46.140965 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6761362b-ea4d-493b-9138-cf2b6cc2ccab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:28:46.141636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6761362b-ea4d-493b-9138-cf2b6cc2ccab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: b9a45700-cf5d-492c-8293-19841bf629a4] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:28:46.149846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6761362b-ea4d-493b-9138-cf2b6cc2ccab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:28:46.150333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6761362b-ea4d-493b-9138-cf2b6cc2ccab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:28:46.151431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6761362b-ea4d-493b-9138-cf2b6cc2ccab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:28:46.151929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6761362b-ea4d-493b-9138-cf2b6cc2ccab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:28:46.209340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-6761362b-ea4d-493b-9138-cf2b6cc2ccab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] HTTP exception thrown: Instance b9a45700-cf5d-492c-8293-19841bf629a4 could not be found. Dec 21 04:28:46.210010 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6761362b-ea4d-493b-9138-cf2b6cc2ccab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Returning 404 to user: Instance b9a45700-cf5d-492c-8293-19841bf629a4 could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:28:46.210944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6761362b-ea4d-493b-9138-cf2b6cc2ccab tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4" status: 404 len: 111 microversion: 2.1 time: 0.079747 Dec 21 04:28:46.211563 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 767/1495] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:28:46 2020] GET /compute/v2.1/servers/b9a45700-cf5d-492c-8293-19841bf629a4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:28:47.293421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:28:47.293908 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:28:47 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:29:06.086729 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:29:06.087258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:29:06 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:29:06.497167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:29:06.497376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:29:06 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:29:14.723126 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:29:14.723614 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:29:14 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:29:17.012781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:29:17.013264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:29:17 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:30:26.168425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:30:26.168944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:30:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:32:07.310925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:32:07.311402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:32:07 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:32:26.103879 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:32:26.104338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:32:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:32:26.513698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:32:26.513871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:32:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:32:34.740634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:32:34.741091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:32:34 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:32:37.029605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:32:37.030616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:32:37 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:33:46.187088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:33:46.187615 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:33:46 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:34:46.651562 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27fe5106-18ea-44c6-8644-655b910d6119] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 21 04:34:46.661101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4dc4cdd2-888f-4935-a245-95d5aa39f5ec tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:34:46.661658 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4dc4cdd2-888f-4935-a245-95d5aa39f5ec tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:34:46.669605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4dc4cdd2-888f-4935-a245-95d5aa39f5ec tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:34:46.670130 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4dc4cdd2-888f-4935-a245-95d5aa39f5ec tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:34:46.671643 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4dc4cdd2-888f-4935-a245-95d5aa39f5ec tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:34:46.672416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4dc4cdd2-888f-4935-a245-95d5aa39f5ec tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:34:46.726028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-4dc4cdd2-888f-4935-a245-95d5aa39f5ec tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] HTTP exception thrown: Instance 37226a3f-240e-4e04-9813-fa3d109452de could not be found. Dec 21 04:34:46.726703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4dc4cdd2-888f-4935-a245-95d5aa39f5ec tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Returning 404 to user: Instance 37226a3f-240e-4e04-9813-fa3d109452de could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:34:46.727637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4dc4cdd2-888f-4935-a245-95d5aa39f5ec tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "DELETE /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 404 len: 111 microversion: 2.1 time: 0.077605 Dec 21 04:34:46.728237 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 729/1496] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:34:46 2020] DELETE /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:34:46.735306 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dca63194-cb64-420f-b69a-f6c254fed282] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 21 04:34:46.744364 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-028f68f1-8fbe-4d04-b465-2a9bbda57c18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:34:46.744977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-028f68f1-8fbe-4d04-b465-2a9bbda57c18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] [instance: 37226a3f-240e-4e04-9813-fa3d109452de] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:34:46.752934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-028f68f1-8fbe-4d04-b465-2a9bbda57c18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:34:46.753445 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-028f68f1-8fbe-4d04-b465-2a9bbda57c18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:34:46.754264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-028f68f1-8fbe-4d04-b465-2a9bbda57c18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:34:46.754753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-028f68f1-8fbe-4d04-b465-2a9bbda57c18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:34:46.806697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-028f68f1-8fbe-4d04-b465-2a9bbda57c18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] HTTP exception thrown: Instance 37226a3f-240e-4e04-9813-fa3d109452de could not be found. Dec 21 04:34:46.807397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-028f68f1-8fbe-4d04-b465-2a9bbda57c18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] Returning 404 to user: Instance 37226a3f-240e-4e04-9813-fa3d109452de could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:34:46.808275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-028f68f1-8fbe-4d04-b465-2a9bbda57c18 tempest-AttachVolumeShelveTestJSON-647402538 tempest-AttachVolumeShelveTestJSON-647402538] 10.222.0.16 "GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de" status: 404 len: 111 microversion: 2.1 time: 0.075710 Dec 21 04:34:46.808862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 768/1497] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:34:46 2020] GET /compute/v2.1/servers/37226a3f-240e-4e04-9813-fa3d109452de => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:35:27.342956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:35:27.343425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:35:27 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:35:46.121546 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:35:46.122348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:35:46 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:35:46.530440 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:35:46.530594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:35:46 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:35:54.759260 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:35:54.759711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:35:54 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:35:57.047298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:35:57.047765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:35:57 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:37:06.203819 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:37:06.204297 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:37:06 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:38:47.360985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:38:47.361441 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:38:47 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:39:06.140579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:39:06.141262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:39:06 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:39:06.547210 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:39:06.547355 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:39:06 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:39:14.776950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:39:14.777528 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:39:14 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:39:17.075550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:39:17.076026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:39:17 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:40:25.638114 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1761530694", "imageRef": "207fafd4-25f4-4407-8994-832167819bf9", "flavorRef": "452"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:40:25.694543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] [27fe5106-18ea-44c6-8644-655b910d6119] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46904. Dec 21 04:40:26.030680 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] validate_networks() for None {{(pid=94298) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:40:26.220941 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:40:26.221183 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:40:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Dec 21 04:40:26.338664 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Flavor limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:40:26.339170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Image limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:40:26.339823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Flavor pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:40:26.340280 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Image pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:40:26.340759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:40:26.351408 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:26.351913 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:26.352837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:26.353331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:26.378572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Getting quotas for project a3cbcccfa66a4f6daafb4d9b2edb4768. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:40:26.382969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Getting quotas for user fe390e1a582d406cad1c6d6e059ab1be and project a3cbcccfa66a4f6daafb4d9b2edb4768. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:40:26.394871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Going to run 1 instances... {{(pid=94298) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:40:26.397772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='207fafd4-25f4-4407-8994-832167819bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:40:26.502321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1ff9f225-c55d-46cf-a711-6bc7e4eabce3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875088 Dec 21 04:40:26.505437 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 730/1498] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:40:25 2020] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:40:26.533959 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4edc420d-b529-414a-a563-3669379a3cf2 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:26.534875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4edc420d-b529-414a-a563-3669379a3cf2 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:26.617827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] [dca63194-cb64-420f-b69a-f6c254fed282] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46926. Dec 21 04:40:26.956331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4edc420d-b529-414a-a563-3669379a3cf2 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:26.965679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4edc420d-b529-414a-a563-3669379a3cf2 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1215 microversion: 2.1 time: 0.453319 Dec 21 04:40:26.966579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 769/1499] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:26 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1215 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:40:27.991357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-11684a60-6449-4128-976b-5d7c38f4722d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:27.992919 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-11684a60-6449-4128-976b-5d7c38f4722d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:28.001956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11684a60-6449-4128-976b-5d7c38f4722d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:28.002472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11684a60-6449-4128-976b-5d7c38f4722d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:28.003367 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11684a60-6449-4128-976b-5d7c38f4722d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:28.003876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11684a60-6449-4128-976b-5d7c38f4722d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:28.176574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-11684a60-6449-4128-976b-5d7c38f4722d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:28.187908 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-11684a60-6449-4128-976b-5d7c38f4722d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1267 microversion: 2.1 time: 0.206872 Dec 21 04:40:28.188775 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 731/1500] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:27 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:29.212070 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-590dd52d-f04a-4a89-a1e0-d3d1cc79f10f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:29.212751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-590dd52d-f04a-4a89-a1e0-d3d1cc79f10f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:29.222332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-590dd52d-f04a-4a89-a1e0-d3d1cc79f10f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:29.222843 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-590dd52d-f04a-4a89-a1e0-d3d1cc79f10f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:29.223719 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-590dd52d-f04a-4a89-a1e0-d3d1cc79f10f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:29.224214 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-590dd52d-f04a-4a89-a1e0-d3d1cc79f10f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:29.372936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-590dd52d-f04a-4a89-a1e0-d3d1cc79f10f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:29.383426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-590dd52d-f04a-4a89-a1e0-d3d1cc79f10f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1273 microversion: 2.1 time: 0.180790 Dec 21 04:40:29.383995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 770/1501] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:29 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:30.411596 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7720eb5f-2cd1-46dd-ad90-6366db3bd7b0 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:30.412594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7720eb5f-2cd1-46dd-ad90-6366db3bd7b0 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:30.421733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7720eb5f-2cd1-46dd-ad90-6366db3bd7b0 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:30.422259 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7720eb5f-2cd1-46dd-ad90-6366db3bd7b0 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:30.423194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7720eb5f-2cd1-46dd-ad90-6366db3bd7b0 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:30.423683 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7720eb5f-2cd1-46dd-ad90-6366db3bd7b0 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:30.703244 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7720eb5f-2cd1-46dd-ad90-6366db3bd7b0 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:30.714641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7720eb5f-2cd1-46dd-ad90-6366db3bd7b0 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1315 microversion: 2.1 time: 0.315756 Dec 21 04:40:30.723891 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 732/1502] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:30 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:31.738590 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ea03f126-4cc9-4562-b3cb-73991391f05b tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:31.741020 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ea03f126-4cc9-4562-b3cb-73991391f05b tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:31.754386 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea03f126-4cc9-4562-b3cb-73991391f05b tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:31.754889 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea03f126-4cc9-4562-b3cb-73991391f05b tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:31.755755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea03f126-4cc9-4562-b3cb-73991391f05b tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:31.756245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ea03f126-4cc9-4562-b3cb-73991391f05b tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:32.153486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ea03f126-4cc9-4562-b3cb-73991391f05b tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:32.165138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ea03f126-4cc9-4562-b3cb-73991391f05b tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1315 microversion: 2.1 time: 0.435863 Dec 21 04:40:32.165726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 771/1503] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:31 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:33.191464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a4576db6-adae-4f15-ab1e-be14bd315af3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:33.192141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a4576db6-adae-4f15-ab1e-be14bd315af3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:33.200750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4576db6-adae-4f15-ab1e-be14bd315af3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:33.201581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4576db6-adae-4f15-ab1e-be14bd315af3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:33.206677 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4576db6-adae-4f15-ab1e-be14bd315af3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:33.210424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4576db6-adae-4f15-ab1e-be14bd315af3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:33.510887 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a4576db6-adae-4f15-ab1e-be14bd315af3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:33.520532 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a4576db6-adae-4f15-ab1e-be14bd315af3 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1315 microversion: 2.1 time: 0.338872 Dec 21 04:40:33.521122 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 733/1504] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:33 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:34.379192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-2d190c42-b865-4096-89da-c02ad1d38004 req-bf3b82e0-32fe-4ff0-87c4-ab063e20c522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3623b6-9dd5-4e2f-825a-406c0036ba51", "tag": "5aa6d5f6-e1cd-4b66-84d3-0d9f7859c7fd"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:40:34.386579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:40:34.386579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:40:34.396769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-2d190c42-b865-4096-89da-c02ad1d38004 req-bf3b82e0-32fe-4ff0-87c4-ab063e20c522 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:34.397276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-2d190c42-b865-4096-89da-c02ad1d38004 req-bf3b82e0-32fe-4ff0-87c4-ab063e20c522 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:34.418544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-2d190c42-b865-4096-89da-c02ad1d38004 req-bf3b82e0-32fe-4ff0-87c4-ab063e20c522 service nova] Creating event network-changed:5aa6d5f6-e1cd-4b66-84d3-0d9f7859c7fd for instance 5f3623b6-9dd5-4e2f-825a-406c0036ba51 on hv-cinder-73306 Dec 21 04:40:34.425808 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-2d190c42-b865-4096-89da-c02ad1d38004 req-bf3b82e0-32fe-4ff0-87c4-ab063e20c522 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.290301 Dec 21 04:40:34.426736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 772/1505] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:40:34 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:40:34.546154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7f9dff21-2caf-4456-b940-44c90b37d268 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:34.546748 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7f9dff21-2caf-4456-b940-44c90b37d268 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:34.557336 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f9dff21-2caf-4456-b940-44c90b37d268 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:34.558100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f9dff21-2caf-4456-b940-44c90b37d268 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:34.559167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f9dff21-2caf-4456-b940-44c90b37d268 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:34.559822 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f9dff21-2caf-4456-b940-44c90b37d268 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:34.807111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7f9dff21-2caf-4456-b940-44c90b37d268 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:34.817711 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7f9dff21-2caf-4456-b940-44c90b37d268 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1315 microversion: 2.1 time: 0.281152 Dec 21 04:40:34.818248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 734/1506] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:34 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:35.842461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-80b58761-50b0-4078-be7a-6e6537c13c6d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:35.843463 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-80b58761-50b0-4078-be7a-6e6537c13c6d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:35.852409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-80b58761-50b0-4078-be7a-6e6537c13c6d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:35.853189 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-80b58761-50b0-4078-be7a-6e6537c13c6d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:35.854249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-80b58761-50b0-4078-be7a-6e6537c13c6d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:35.855028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-80b58761-50b0-4078-be7a-6e6537c13c6d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:36.085610 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-80b58761-50b0-4078-be7a-6e6537c13c6d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:36.096868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-80b58761-50b0-4078-be7a-6e6537c13c6d tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1315 microversion: 2.1 time: 0.264509 Dec 21 04:40:36.097695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 773/1507] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:35 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:37.120494 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c8d94cd9-4046-4311-91e0-7309bf27b03e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:37.121845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c8d94cd9-4046-4311-91e0-7309bf27b03e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:37.130992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8d94cd9-4046-4311-91e0-7309bf27b03e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:37.131826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8d94cd9-4046-4311-91e0-7309bf27b03e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:37.132882 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8d94cd9-4046-4311-91e0-7309bf27b03e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:37.133581 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c8d94cd9-4046-4311-91e0-7309bf27b03e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:37.376431 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c8d94cd9-4046-4311-91e0-7309bf27b03e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:37.387857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c8d94cd9-4046-4311-91e0-7309bf27b03e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1315 microversion: 2.1 time: 0.276583 Dec 21 04:40:37.389350 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 735/1508] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:37 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:38.338442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-313ba7cf-a535-43a8-bf8f-b9e764b4bad1 req-510bfbef-77be-44e4-9c1e-8903171b57c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3623b6-9dd5-4e2f-825a-406c0036ba51", "name": "network-vif-plugged", "status": "completed", "tag": "5aa6d5f6-e1cd-4b66-84d3-0d9f7859c7fd"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:40:38.347699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:40:38.347699 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:40:38.358113 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-313ba7cf-a535-43a8-bf8f-b9e764b4bad1 req-510bfbef-77be-44e4-9c1e-8903171b57c2 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:38.359098 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-313ba7cf-a535-43a8-bf8f-b9e764b4bad1 req-510bfbef-77be-44e4-9c1e-8903171b57c2 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:38.380482 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-313ba7cf-a535-43a8-bf8f-b9e764b4bad1 req-510bfbef-77be-44e4-9c1e-8903171b57c2 service nova] Creating event network-vif-plugged:5aa6d5f6-e1cd-4b66-84d3-0d9f7859c7fd for instance 5f3623b6-9dd5-4e2f-825a-406c0036ba51 on hv-cinder-73306 Dec 21 04:40:38.386245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-313ba7cf-a535-43a8-bf8f-b9e764b4bad1 req-510bfbef-77be-44e4-9c1e-8903171b57c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166106 Dec 21 04:40:38.386936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 774/1509] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:40:38 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:40:38.411914 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6465d94f-01a5-4d86-b3bb-dcf46949861f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:38.412793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6465d94f-01a5-4d86-b3bb-dcf46949861f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:38.421252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6465d94f-01a5-4d86-b3bb-dcf46949861f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:38.422002 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6465d94f-01a5-4d86-b3bb-dcf46949861f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:38.422999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6465d94f-01a5-4d86-b3bb-dcf46949861f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:38.423639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6465d94f-01a5-4d86-b3bb-dcf46949861f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:38.665757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-6465d94f-01a5-4d86-b3bb-dcf46949861f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:38.677944 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6465d94f-01a5-4d86-b3bb-dcf46949861f tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1315 microversion: 2.1 time: 0.275867 Dec 21 04:40:38.678554 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 736/1510] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:38 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:39.695560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1055c608-bb91-44a1-a88c-d5446f7ef1b4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'create', calling method: .version_select at 0x7f2bb8668ae8>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-710794790"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:40:39.702540 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-75e21305-aa38-4a33-9ff0-1b28b7cf3cee tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:39.703248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-75e21305-aa38-4a33-9ff0-1b28b7cf3cee tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:39.711258 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75e21305-aa38-4a33-9ff0-1b28b7cf3cee tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:39.711758 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75e21305-aa38-4a33-9ff0-1b28b7cf3cee tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:39.712594 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75e21305-aa38-4a33-9ff0-1b28b7cf3cee tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:39.713081 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-75e21305-aa38-4a33-9ff0-1b28b7cf3cee tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:39.725454 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-1055c608-bb91-44a1-a88c-d5446f7ef1b4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Getting quotas for project c9a3b1a5cbe74271b3ec25d419290273. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:40:39.729721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-1055c608-bb91-44a1-a88c-d5446f7ef1b4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Getting quotas for user 045cd7a8d06743879fea0de525792bef and project c9a3b1a5cbe74271b3ec25d419290273. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:40:39.925014 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-1055c608-bb91-44a1-a88c-d5446f7ef1b4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Getting quotas for project c9a3b1a5cbe74271b3ec25d419290273. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:40:39.929082 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-1055c608-bb91-44a1-a88c-d5446f7ef1b4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Getting quotas for user 045cd7a8d06743879fea0de525792bef and project c9a3b1a5cbe74271b3ec25d419290273. Resources: {'key_pairs'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:40:39.934787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-75e21305-aa38-4a33-9ff0-1b28b7cf3cee tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:39.944403 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-75e21305-aa38-4a33-9ff0-1b28b7cf3cee tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1315 microversion: 2.1 time: 0.251759 Dec 21 04:40:39.945004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 737/1511] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:39 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:40:39.945514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1055c608-bb91-44a1-a88c-d5446f7ef1b4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.398098 Dec 21 04:40:39.946312 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 775/1512] 10.222.0.16 () {60 vars in 1148 bytes} [Mon Dec 21 04:40:39 2020] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:40:39.962249 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-427bd60a-3a9c-429e-9d20-dafd6bea546d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'create', calling method: .version_select at 0x7f2bb8fea840>, body: {"security_group": {"name": "tempest-TestVolumeBootPattern-625897284", "description": "tempest-TestVolumeBootPattern-625897284 description"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:40:40.173205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-427bd60a-3a9c-429e-9d20-dafd6bea546d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.219992 Dec 21 04:40:40.173872 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 738/1513] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Dec 21 04:40:39 2020] POST /compute/v2.1/os-security-groups => generated 249 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:40:40.192195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3da0bc51-e450-400b-bfd7-36b46ec1e196 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'create', calling method: .version_select at 0x7f2bbd948268>, body: {"security_group_rule": {"parent_group_id": "6fede065-0892-41d0-bb3a-d0f335bafeea", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:40:40.415875 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3da0bc51-e450-400b-bfd7-36b46ec1e196 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.233814 Dec 21 04:40:40.416537 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 776/1514] 10.222.0.16 () {60 vars in 1185 bytes} [Mon Dec 21 04:40:40 2020] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:40:40.432779 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1eca25d0-b812-4777-9946-d6d68d2de1bb tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'create', calling method: .version_select at 0x7f2bb8572c80>, body: {"security_group_rule": {"parent_group_id": "6fede065-0892-41d0-bb3a-d0f335bafeea", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:40:40.652347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1eca25d0-b812-4777-9946-d6d68d2de1bb tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.228524 Dec 21 04:40:40.653001 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 739/1515] 10.222.0.16 () {60 vars in 1185 bytes} [Mon Dec 21 04:40:40 2020] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:40:40.968876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-63914912-3d04-4bdf-be5b-417b9050a3db tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:40.969661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-63914912-3d04-4bdf-be5b-417b9050a3db tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:40.978062 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-63914912-3d04-4bdf-be5b-417b9050a3db tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:40.978568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-63914912-3d04-4bdf-be5b-417b9050a3db tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:40.979435 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-63914912-3d04-4bdf-be5b-417b9050a3db tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:40.979934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-63914912-3d04-4bdf-be5b-417b9050a3db tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:41.244111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-63914912-3d04-4bdf-be5b-417b9050a3db tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:41.256444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-63914912-3d04-4bdf-be5b-417b9050a3db tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1465 microversion: 2.1 time: 0.296997 Dec 21 04:40:41.257132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 777/1516] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:40 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1465 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:41.344560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e69ebc03-9a77-4033-8b31-dbbdaf987464 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:41.345413 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e69ebc03-9a77-4033-8b31-dbbdaf987464 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:41.355726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e69ebc03-9a77-4033-8b31-dbbdaf987464 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:41.356211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e69ebc03-9a77-4033-8b31-dbbdaf987464 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:41.357310 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e69ebc03-9a77-4033-8b31-dbbdaf987464 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:41.358401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e69ebc03-9a77-4033-8b31-dbbdaf987464 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:41.432173 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e69ebc03-9a77-4033-8b31-dbbdaf987464 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Going to try to terminate instance {{(pid=94298) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:40:41.557785 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e69ebc03-9a77-4033-8b31-dbbdaf987464 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "DELETE /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 204 len: 0 microversion: 2.1 time: 0.222896 Dec 21 04:40:41.562032 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 740/1517] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:40:41 2020] DELETE /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:40:41.574630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f6e8baee-34c7-454c-91c8-6ef2425af452 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:41.575332 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f6e8baee-34c7-454c-91c8-6ef2425af452 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:41.583736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f6e8baee-34c7-454c-91c8-6ef2425af452 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:41.584243 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f6e8baee-34c7-454c-91c8-6ef2425af452 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:41.585073 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f6e8baee-34c7-454c-91c8-6ef2425af452 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:41.585570 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f6e8baee-34c7-454c-91c8-6ef2425af452 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:41.819251 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f6e8baee-34c7-454c-91c8-6ef2425af452 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:41.828831 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f6e8baee-34c7-454c-91c8-6ef2425af452 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1471 microversion: 2.1 time: 0.265183 Dec 21 04:40:41.829421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 778/1518] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:41 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1471 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:42.853846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b3281929-dab4-45c4-9727-108ecc132f00 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:42.854546 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b3281929-dab4-45c4-9727-108ecc132f00 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:42.862452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3281929-dab4-45c4-9727-108ecc132f00 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:42.862991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3281929-dab4-45c4-9727-108ecc132f00 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:42.863834 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3281929-dab4-45c4-9727-108ecc132f00 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:42.864330 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b3281929-dab4-45c4-9727-108ecc132f00 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:43.104320 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b3281929-dab4-45c4-9727-108ecc132f00 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:43.115069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b3281929-dab4-45c4-9727-108ecc132f00 tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1471 microversion: 2.1 time: 0.271373 Dec 21 04:40:43.115924 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 741/1519] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:42 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1471 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:44.026283 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-2237d2c4-bdb8-4efb-84f3-e4cdc0bacb9f req-d94a93fd-600f-4c1a-8b0b-7ffaafa7871e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3623b6-9dd5-4e2f-825a-406c0036ba51", "name": "network-vif-deleted", "tag": "5aa6d5f6-e1cd-4b66-84d3-0d9f7859c7fd"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:40:44.034165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:40:44.034165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:40:44.049132 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-2237d2c4-bdb8-4efb-84f3-e4cdc0bacb9f req-d94a93fd-600f-4c1a-8b0b-7ffaafa7871e service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:44.049650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-2237d2c4-bdb8-4efb-84f3-e4cdc0bacb9f req-d94a93fd-600f-4c1a-8b0b-7ffaafa7871e service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:44.069496 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-2237d2c4-bdb8-4efb-84f3-e4cdc0bacb9f req-d94a93fd-600f-4c1a-8b0b-7ffaafa7871e service nova] Creating event network-vif-deleted:5aa6d5f6-e1cd-4b66-84d3-0d9f7859c7fd for instance 5f3623b6-9dd5-4e2f-825a-406c0036ba51 on hv-cinder-73306 Dec 21 04:40:44.074861 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-2237d2c4-bdb8-4efb-84f3-e4cdc0bacb9f req-d94a93fd-600f-4c1a-8b0b-7ffaafa7871e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058018 Dec 21 04:40:44.075745 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 779/1520] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:40:44 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:40:44.143478 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-29d43dd0-aefd-44bb-9e47-31b0868d8a5e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:44.144165 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-29d43dd0-aefd-44bb-9e47-31b0868d8a5e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:44.152967 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-29d43dd0-aefd-44bb-9e47-31b0868d8a5e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:44.153485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-29d43dd0-aefd-44bb-9e47-31b0868d8a5e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:44.155095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-29d43dd0-aefd-44bb-9e47-31b0868d8a5e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:44.156262 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-29d43dd0-aefd-44bb-9e47-31b0868d8a5e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:44.243730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-29d43dd0-aefd-44bb-9e47-31b0868d8a5e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:44.244252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-29d43dd0-aefd-44bb-9e47-31b0868d8a5e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:44.244771 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-29d43dd0-aefd-44bb-9e47-31b0868d8a5e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lazy-loading 'fault' on Instance uuid 5f3623b6-9dd5-4e2f-825a-406c0036ba51 {{(pid=94298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:40:44.316146 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-29d43dd0-aefd-44bb-9e47-31b0868d8a5e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe390e1a582d406cad1c6d6e059ab1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cbcccfa66a4f6daafb4d9b2edb4768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:44.324992 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-29d43dd0-aefd-44bb-9e47-31b0868d8a5e tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 200 len: 1305 microversion: 2.1 time: 0.192436 Dec 21 04:40:44.325587 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 742/1521] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:44 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 1305 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:45.349969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6d772ac1-669c-4df6-898c-26316b1d2a4a tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:45.350727 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-6d772ac1-669c-4df6-898c-26316b1d2a4a tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] [instance: 5f3623b6-9dd5-4e2f-825a-406c0036ba51] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:45.358871 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6d772ac1-669c-4df6-898c-26316b1d2a4a tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:45.359424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6d772ac1-669c-4df6-898c-26316b1d2a4a tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:45.360240 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6d772ac1-669c-4df6-898c-26316b1d2a4a tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:45.360728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-6d772ac1-669c-4df6-898c-26316b1d2a4a tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:45.417446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-6d772ac1-669c-4df6-898c-26316b1d2a4a tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] HTTP exception thrown: Instance 5f3623b6-9dd5-4e2f-825a-406c0036ba51 could not be found. Dec 21 04:40:45.418108 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-6d772ac1-669c-4df6-898c-26316b1d2a4a tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] Returning 404 to user: Instance 5f3623b6-9dd5-4e2f-825a-406c0036ba51 could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:40:45.419025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-6d772ac1-669c-4df6-898c-26316b1d2a4a tempest-VolumesNegativeTest-596689894 tempest-VolumesNegativeTest-596689894] 10.222.0.16 "GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51" status: 404 len: 111 microversion: 2.1 time: 0.078943 Dec 21 04:40:45.419630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 780/1522] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:45 2020] GET /compute/v2.1/servers/5f3623b6-9dd5-4e2f-825a-406c0036ba51 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:40:57.075694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1497834582", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-710794790", "security_groups": [{"name": "tempest-TestVolumeBootPattern-625897284"}], "block_device_mapping_v2": [{"uuid": "ee74b040-1720-49f4-9c78-923d0f1dd69d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d868963-851b-4b8f-95e5-ad6093b907aa"}]}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:40:57.274047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] validate_networks() for [('6d868963-851b-4b8f-95e5-ad6093b907aa', None, None, None)] {{(pid=94298) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:40:57.991991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Flavor limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:40:57.992500 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Image limits 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:40:57.993298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Flavor pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:40:57.993755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Image pref 0:0:0 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:40:57.994216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:40:58.003652 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:58.004157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:58.005028 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:58.005520 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:58.024728 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Getting quotas for project c9a3b1a5cbe74271b3ec25d419290273. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:40:58.029048 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Getting quotas for user 045cd7a8d06743879fea0de525792bef and project c9a3b1a5cbe74271b3ec25d419290273. Resources: {'instances', 'cores', 'ram'} {{(pid=94298) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:40:58.134608 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Going to run 1 instances... {{(pid=94298) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:40:58.137058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee74b040-1720-49f4-9c78-923d0f1dd69d',volume_size=None,volume_type=None)] {{(pid=94298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:40:58.316565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-bb238c05-18f5-4a64-8620-440bc049ae53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 1.249961 Dec 21 04:40:58.317259 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 743/1523] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:40:57 2020] POST /compute/v2.1/servers => generated 412 bytes in 1251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:40:58.334826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2c8eae87-31b5-42bf-a760-5b6317505132 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:58.335673 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2c8eae87-31b5-42bf-a760-5b6317505132 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:58.425969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2c8eae87-31b5-42bf-a760-5b6317505132 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:58.434141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2c8eae87-31b5-42bf-a760-5b6317505132 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1094 microversion: 2.1 time: 0.110214 Dec 21 04:40:58.434737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 781/1524] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:58 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1094 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:40:59.462487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a37226a5-a96e-4635-8bf2-34d896f860f1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:40:59.463263 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a37226a5-a96e-4635-8bf2-34d896f860f1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:40:59.474827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a37226a5-a96e-4635-8bf2-34d896f860f1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:59.475792 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a37226a5-a96e-4635-8bf2-34d896f860f1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:59.477067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a37226a5-a96e-4635-8bf2-34d896f860f1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:40:59.477934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a37226a5-a96e-4635-8bf2-34d896f860f1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:40:59.626938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a37226a5-a96e-4635-8bf2-34d896f860f1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:40:59.635921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a37226a5-a96e-4635-8bf2-34d896f860f1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1210 microversion: 2.1 time: 0.187025 Dec 21 04:40:59.636639 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 744/1525] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:40:59 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1210 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:00.660335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7346b7de-a216-42f9-8210-6a22137c9b9c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:41:00.661011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7346b7de-a216-42f9-8210-6a22137c9b9c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:00.670162 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7346b7de-a216-42f9-8210-6a22137c9b9c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:00.670670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7346b7de-a216-42f9-8210-6a22137c9b9c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:00.671551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7346b7de-a216-42f9-8210-6a22137c9b9c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:00.672045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7346b7de-a216-42f9-8210-6a22137c9b9c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:01.127669 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7346b7de-a216-42f9-8210-6a22137c9b9c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:41:01.136636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7346b7de-a216-42f9-8210-6a22137c9b9c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1272 microversion: 2.1 time: 0.486503 Dec 21 04:41:01.137333 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 782/1526] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:41:00 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1272 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:02.071991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-7c9277dc-4c03-4100-880f-a4c9409259ca req-23758d2f-f742-4527-b3c1-03dba25031f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5220415-dcff-467b-ab6e-2d51f7e716dc", "tag": "69add522-0ba4-40f0-900d-61b23857fd14"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:41:02.079846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:02.079846 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:41:02.089048 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-7c9277dc-4c03-4100-880f-a4c9409259ca req-23758d2f-f742-4527-b3c1-03dba25031f7 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:02.089547 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-7c9277dc-4c03-4100-880f-a4c9409259ca req-23758d2f-f742-4527-b3c1-03dba25031f7 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:02.109238 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-7c9277dc-4c03-4100-880f-a4c9409259ca req-23758d2f-f742-4527-b3c1-03dba25031f7 service nova] Creating event network-changed:69add522-0ba4-40f0-900d-61b23857fd14 for instance d5220415-dcff-467b-ab6e-2d51f7e716dc on hv-cinder-73306 Dec 21 04:41:02.114696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-7c9277dc-4c03-4100-880f-a4c9409259ca req-23758d2f-f742-4527-b3c1-03dba25031f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051675 Dec 21 04:41:02.115381 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 745/1527] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:41:02 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:41:02.162070 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-3634662f-e180-4aa8-ace2-50dbbef156e9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:41:02.162755 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-3634662f-e180-4aa8-ace2-50dbbef156e9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:02.172058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3634662f-e180-4aa8-ace2-50dbbef156e9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:02.172574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3634662f-e180-4aa8-ace2-50dbbef156e9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:02.173491 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3634662f-e180-4aa8-ace2-50dbbef156e9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:02.173904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-3634662f-e180-4aa8-ace2-50dbbef156e9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:02.395936 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-3634662f-e180-4aa8-ace2-50dbbef156e9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:41:02.405566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-3634662f-e180-4aa8-ace2-50dbbef156e9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1272 microversion: 2.1 time: 0.254296 Dec 21 04:41:02.406101 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 783/1528] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:41:02 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:03.429586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d26622f5-af54-47ef-9ce0-d18d6576b211 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:41:03.430370 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d26622f5-af54-47ef-9ce0-d18d6576b211 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:03.439302 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d26622f5-af54-47ef-9ce0-d18d6576b211 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:03.439826 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d26622f5-af54-47ef-9ce0-d18d6576b211 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:03.440685 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d26622f5-af54-47ef-9ce0-d18d6576b211 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:03.441188 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d26622f5-af54-47ef-9ce0-d18d6576b211 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:03.661816 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-d26622f5-af54-47ef-9ce0-d18d6576b211 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:41:03.671223 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d26622f5-af54-47ef-9ce0-d18d6576b211 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1272 microversion: 2.1 time: 0.251573 Dec 21 04:41:03.671828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 746/1529] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:41:03 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:04.694192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-79d366c6-f0a7-4e7c-9eea-54d4c91c6b52 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:41:04.694766 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-79d366c6-f0a7-4e7c-9eea-54d4c91c6b52 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:04.703345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-79d366c6-f0a7-4e7c-9eea-54d4c91c6b52 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:04.703849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-79d366c6-f0a7-4e7c-9eea-54d4c91c6b52 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:04.704670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-79d366c6-f0a7-4e7c-9eea-54d4c91c6b52 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:04.705156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-79d366c6-f0a7-4e7c-9eea-54d4c91c6b52 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:04.923524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-79d366c6-f0a7-4e7c-9eea-54d4c91c6b52 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:41:04.932322 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-79d366c6-f0a7-4e7c-9eea-54d4c91c6b52 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1272 microversion: 2.1 time: 0.247941 Dec 21 04:41:04.932904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 784/1530] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:41:04 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:05.956569 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-51f82f90-f943-4695-8573-71eebbb059c5 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:41:05.957245 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-51f82f90-f943-4695-8573-71eebbb059c5 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:05.965164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-51f82f90-f943-4695-8573-71eebbb059c5 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:05.965672 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-51f82f90-f943-4695-8573-71eebbb059c5 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:05.966508 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-51f82f90-f943-4695-8573-71eebbb059c5 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:05.967036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-51f82f90-f943-4695-8573-71eebbb059c5 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:06.183411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-51f82f90-f943-4695-8573-71eebbb059c5 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:41:06.192233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-51f82f90-f943-4695-8573-71eebbb059c5 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1272 microversion: 2.1 time: 0.245207 Dec 21 04:41:06.192836 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 747/1531] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:41:05 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1272 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:07.215338 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-68ca10b9-e2af-47e2-a418-aeaffb66da66 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:41:07.216006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-68ca10b9-e2af-47e2-a418-aeaffb66da66 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:07.224458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68ca10b9-e2af-47e2-a418-aeaffb66da66 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:07.224962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68ca10b9-e2af-47e2-a418-aeaffb66da66 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:07.225791 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68ca10b9-e2af-47e2-a418-aeaffb66da66 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:07.226285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-68ca10b9-e2af-47e2-a418-aeaffb66da66 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:07.444670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-68ca10b9-e2af-47e2-a418-aeaffb66da66 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:41:07.454603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-68ca10b9-e2af-47e2-a418-aeaffb66da66 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1272 microversion: 2.1 time: 0.248482 Dec 21 04:41:07.464995 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 785/1532] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:41:07 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:08.478301 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f2d973f4-36d2-4957-9c80-9b24af93e97f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:41:08.478990 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f2d973f4-36d2-4957-9c80-9b24af93e97f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:08.487707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2d973f4-36d2-4957-9c80-9b24af93e97f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:08.488216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2d973f4-36d2-4957-9c80-9b24af93e97f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:08.489050 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2d973f4-36d2-4957-9c80-9b24af93e97f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:08.489542 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f2d973f4-36d2-4957-9c80-9b24af93e97f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:08.711777 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-f2d973f4-36d2-4957-9c80-9b24af93e97f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:41:08.720969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f2d973f4-36d2-4957-9c80-9b24af93e97f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1272 microversion: 2.1 time: 0.252049 Dec 21 04:41:08.721573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 748/1533] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:41:08 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:09.744224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0a3878ac-89b0-4704-8964-54b60215c722 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:41:09.744814 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0a3878ac-89b0-4704-8964-54b60215c722 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:09.752665 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a3878ac-89b0-4704-8964-54b60215c722 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:09.753167 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a3878ac-89b0-4704-8964-54b60215c722 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:09.753980 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a3878ac-89b0-4704-8964-54b60215c722 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:09.754464 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0a3878ac-89b0-4704-8964-54b60215c722 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:09.967675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0a3878ac-89b0-4704-8964-54b60215c722 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:41:09.976443 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0a3878ac-89b0-4704-8964-54b60215c722 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1272 microversion: 2.1 time: 0.241699 Dec 21 04:41:09.977036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 786/1534] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:41:09 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:11.000345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c7a02762-a43a-4fe9-922e-6b7f0e26f1ad tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:41:11.001004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c7a02762-a43a-4fe9-922e-6b7f0e26f1ad tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:11.009013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7a02762-a43a-4fe9-922e-6b7f0e26f1ad tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:11.009514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7a02762-a43a-4fe9-922e-6b7f0e26f1ad tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:11.010340 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7a02762-a43a-4fe9-922e-6b7f0e26f1ad tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:11.010823 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7a02762-a43a-4fe9-922e-6b7f0e26f1ad tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:11.232558 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c7a02762-a43a-4fe9-922e-6b7f0e26f1ad tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:41:11.241400 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c7a02762-a43a-4fe9-922e-6b7f0e26f1ad tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1272 microversion: 2.1 time: 0.250985 Dec 21 04:41:11.242004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 749/1535] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:41:10 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:11.627737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-8f9a5f8d-b777-4429-8313-db36f04e26b8 req-0f15e771-f438-492e-90be-9776e9bcdc31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5220415-dcff-467b-ab6e-2d51f7e716dc", "name": "network-vif-plugged", "status": "completed", "tag": "69add522-0ba4-40f0-900d-61b23857fd14"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:41:11.634800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:11.634800 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:41:11.644573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-8f9a5f8d-b777-4429-8313-db36f04e26b8 req-0f15e771-f438-492e-90be-9776e9bcdc31 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:11.645070 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-8f9a5f8d-b777-4429-8313-db36f04e26b8 req-0f15e771-f438-492e-90be-9776e9bcdc31 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:11.662398 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-8f9a5f8d-b777-4429-8313-db36f04e26b8 req-0f15e771-f438-492e-90be-9776e9bcdc31 service nova] Creating event network-vif-plugged:69add522-0ba4-40f0-900d-61b23857fd14 for instance d5220415-dcff-467b-ab6e-2d51f7e716dc on hv-cinder-73306 Dec 21 04:41:11.667950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-8f9a5f8d-b777-4429-8313-db36f04e26b8 req-0f15e771-f438-492e-90be-9776e9bcdc31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052101 Dec 21 04:41:11.668205 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 787/1536] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:41:11 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:41:12.264753 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-5fa5fbfc-54ac-46c7-a7a3-803e1a947961 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:41:12.265415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-5fa5fbfc-54ac-46c7-a7a3-803e1a947961 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:12.273279 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5fa5fbfc-54ac-46c7-a7a3-803e1a947961 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:12.273782 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5fa5fbfc-54ac-46c7-a7a3-803e1a947961 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:12.274605 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5fa5fbfc-54ac-46c7-a7a3-803e1a947961 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:12.275123 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-5fa5fbfc-54ac-46c7-a7a3-803e1a947961 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:12.496069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-5fa5fbfc-54ac-46c7-a7a3-803e1a947961 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:41:12.505006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-5fa5fbfc-54ac-46c7-a7a3-803e1a947961 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1272 microversion: 2.1 time: 0.249471 Dec 21 04:41:12.505595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 750/1537] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:41:12 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:13.529551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-46ac0100-56fd-4744-81ee-a1a5d3ae8492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:41:13.530309 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-46ac0100-56fd-4744-81ee-a1a5d3ae8492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:13.538442 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-46ac0100-56fd-4744-81ee-a1a5d3ae8492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:13.538961 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-46ac0100-56fd-4744-81ee-a1a5d3ae8492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:13.539781 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-46ac0100-56fd-4744-81ee-a1a5d3ae8492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:13.540273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-46ac0100-56fd-4744-81ee-a1a5d3ae8492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:13.760872 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-46ac0100-56fd-4744-81ee-a1a5d3ae8492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:41:13.769799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-46ac0100-56fd-4744-81ee-a1a5d3ae8492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1459 microversion: 2.1 time: 0.250045 Dec 21 04:41:13.770395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 788/1538] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:41:13 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1459 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:13.792469 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7119431a-843e-410f-aa66-1d05f9b62654 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:41:13.793128 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7119431a-843e-410f-aa66-1d05f9b62654 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:13.801634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7119431a-843e-410f-aa66-1d05f9b62654 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:13.802156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7119431a-843e-410f-aa66-1d05f9b62654 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:13.802996 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7119431a-843e-410f-aa66-1d05f9b62654 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:13.803490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7119431a-843e-410f-aa66-1d05f9b62654 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:14.023730 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7119431a-843e-410f-aa66-1d05f9b62654 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:41:14.033801 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7119431a-843e-410f-aa66-1d05f9b62654 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1459 microversion: 2.1 time: 0.250271 Dec 21 04:41:14.034395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 751/1539] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:41:13 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1459 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:41:14.056951 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a366e9a3-db67-4878-8bba-e929fd3e4c00 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'create', calling method: .version_select at 0x7f2bb83d0f28>, body: {"pool": null} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:41:16.108051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a366e9a3-db67-4878-8bba-e929fd3e4c00 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.059820 Dec 21 04:41:16.108833 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 789/1540] 10.222.0.16 () {60 vars in 1160 bytes} [Mon Dec 21 04:41:14 2020] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:41:16.126195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ed7fca44-c683-4293-b635-6ac0a9622a84 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.19"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:41:16.127455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ed7fca44-c683-4293-b635-6ac0a9622a84 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:41:16.135344 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed7fca44-c683-4293-b635-6ac0a9622a84 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:16.135863 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed7fca44-c683-4293-b635-6ac0a9622a84 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:16.136697 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed7fca44-c683-4293-b635-6ac0a9622a84 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:16.137193 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed7fca44-c683-4293-b635-6ac0a9622a84 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:16.207630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed7fca44-c683-4293-b635-6ac0a9622a84 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Acquired lock "refresh_cache-d5220415-dcff-467b-ab6e-2d51f7e716dc" {{(pid=94298) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 21 04:41:18.090565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-ed7fca44-c683-4293-b635-6ac0a9622a84 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Building network info cache for instance {{(pid=94298) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 21 04:41:18.269579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-3298619f-9885-49b2-b3dc-d1fd508d3a5e req-f99d2c00-6096-44c7-b1b4-720755368e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5220415-dcff-467b-ab6e-2d51f7e716dc", "tag": "69add522-0ba4-40f0-900d-61b23857fd14"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:41:18.276376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:18.276376 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:41:18.286196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-3298619f-9885-49b2-b3dc-d1fd508d3a5e req-f99d2c00-6096-44c7-b1b4-720755368e42 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:41:18.287067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-3298619f-9885-49b2-b3dc-d1fd508d3a5e req-f99d2c00-6096-44c7-b1b4-720755368e42 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:41:18.303955 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-3298619f-9885-49b2-b3dc-d1fd508d3a5e req-f99d2c00-6096-44c7-b1b4-720755368e42 service nova] Creating event network-changed:69add522-0ba4-40f0-900d-61b23857fd14 for instance d5220415-dcff-467b-ab6e-2d51f7e716dc on hv-cinder-73306 Dec 21 04:41:18.309395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-3298619f-9885-49b2-b3dc-d1fd508d3a5e req-f99d2c00-6096-44c7-b1b4-720755368e42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212319 Dec 21 04:41:18.310429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 790/1541] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:41:18 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:41:18.942921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-ed7fca44-c683-4293-b635-6ac0a9622a84 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Updating instance_info_cache with network_info: [{"id": "69add522-0ba4-40f0-900d-61b23857fd14", "address": "fa:16:3e:f0:71:a4", "network": {"id": "6d868963-851b-4b8f-95e5-ad6093b907aa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1252365335-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c9a3b1a5cbe74271b3ec25d419290273", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap69add522-0b", "ovs_interfaceid": "69add522-0ba4-40f0-900d-61b23857fd14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94298) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 21 04:41:18.953724 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ed7fca44-c683-4293-b635-6ac0a9622a84 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Releasing lock "refresh_cache-d5220415-dcff-467b-ab6e-2d51f7e716dc" {{(pid=94298) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 21 04:41:18.954651 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ed7fca44-c683-4293-b635-6ac0a9622a84 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc/action" status: 202 len: 0 microversion: 2.1 time: 2.838227 Dec 21 04:41:18.955551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 752/1542] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:41:16 2020] POST /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc/action => generated 0 bytes in 2840 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 21 04:42:07.379473 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:42:07.379989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:42:07 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:42:26.160600 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:42:26.161166 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:42:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:43:08.122713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1b802e31-a9a2-4cc7-b7ca-60a425aa2012 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:08.123357 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1b802e31-a9a2-4cc7-b7ca-60a425aa2012 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:08.131953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b802e31-a9a2-4cc7-b7ca-60a425aa2012 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:08.132452 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b802e31-a9a2-4cc7-b7ca-60a425aa2012 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:08.133264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b802e31-a9a2-4cc7-b7ca-60a425aa2012 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:08.133747 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1b802e31-a9a2-4cc7-b7ca-60a425aa2012 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:08.203213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1b802e31-a9a2-4cc7-b7ca-60a425aa2012 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Going to try to terminate instance {{(pid=94299) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:43:08.317862 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1b802e31-a9a2-4cc7-b7ca-60a425aa2012 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "DELETE /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 204 len: 0 microversion: 2.1 time: 0.205557 Dec 21 04:43:08.318670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 791/1543] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:43:08 2020] DELETE /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:43:08.332741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-20518c3d-0b9a-4282-af31-4949dce0062d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:08.333416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-20518c3d-0b9a-4282-af31-4949dce0062d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:08.341686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-20518c3d-0b9a-4282-af31-4949dce0062d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:08.342195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-20518c3d-0b9a-4282-af31-4949dce0062d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:08.343071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-20518c3d-0b9a-4282-af31-4949dce0062d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:08.343574 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-20518c3d-0b9a-4282-af31-4949dce0062d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:08.568417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-20518c3d-0b9a-4282-af31-4949dce0062d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:08.577270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-20518c3d-0b9a-4282-af31-4949dce0062d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1583 microversion: 2.1 time: 0.254095 Dec 21 04:43:08.577866 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 753/1544] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:08 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1583 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:09.603360 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a4af07e7-208b-49fa-960f-ea2542353492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:09.604127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a4af07e7-208b-49fa-960f-ea2542353492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:09.612663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4af07e7-208b-49fa-960f-ea2542353492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:09.613174 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4af07e7-208b-49fa-960f-ea2542353492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:09.614006 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4af07e7-208b-49fa-960f-ea2542353492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:09.614497 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a4af07e7-208b-49fa-960f-ea2542353492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:09.832848 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a4af07e7-208b-49fa-960f-ea2542353492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:09.841806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a4af07e7-208b-49fa-960f-ea2542353492 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1583 microversion: 2.1 time: 0.248930 Dec 21 04:43:09.842395 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 792/1545] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:09 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1583 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:10.095053 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-271e5ac9-3ba1-49ba-8b74-caeb2525266b req-4379a25a-f259-4b0c-9132-3ad8f95b5456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5220415-dcff-467b-ab6e-2d51f7e716dc", "name": "network-vif-unplugged", "status": "completed", "tag": "69add522-0ba4-40f0-900d-61b23857fd14"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:43:10.102656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:43:10.102656 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:43:10.111802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-271e5ac9-3ba1-49ba-8b74-caeb2525266b req-4379a25a-f259-4b0c-9132-3ad8f95b5456 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:10.112293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-271e5ac9-3ba1-49ba-8b74-caeb2525266b req-4379a25a-f259-4b0c-9132-3ad8f95b5456 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:10.130880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-271e5ac9-3ba1-49ba-8b74-caeb2525266b req-4379a25a-f259-4b0c-9132-3ad8f95b5456 service nova] Creating event network-vif-unplugged:69add522-0ba4-40f0-900d-61b23857fd14 for instance d5220415-dcff-467b-ab6e-2d51f7e716dc on hv-cinder-73306 Dec 21 04:43:10.136146 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-271e5ac9-3ba1-49ba-8b74-caeb2525266b req-4379a25a-f259-4b0c-9132-3ad8f95b5456 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052831 Dec 21 04:43:10.136811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 754/1546] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:43:10 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:43:10.867925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-152a8e41-1be4-409f-8eee-1da6f9ce24dc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:10.868590 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-152a8e41-1be4-409f-8eee-1da6f9ce24dc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:10.877047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-152a8e41-1be4-409f-8eee-1da6f9ce24dc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:10.878399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-152a8e41-1be4-409f-8eee-1da6f9ce24dc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:10.879285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-152a8e41-1be4-409f-8eee-1da6f9ce24dc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:10.879802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-152a8e41-1be4-409f-8eee-1da6f9ce24dc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:11.018686 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-152a8e41-1be4-409f-8eee-1da6f9ce24dc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:11.028230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-152a8e41-1be4-409f-8eee-1da6f9ce24dc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1509 microversion: 2.1 time: 0.171151 Dec 21 04:43:11.028835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 793/1547] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:10 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:11.413857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-62209ba0-1857-44a8-86b9-d07f6ca4ff2c req-0e9c40a4-12ab-41e0-995f-0e82d9215806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5220415-dcff-467b-ab6e-2d51f7e716dc", "name": "network-vif-deleted", "tag": "69add522-0ba4-40f0-900d-61b23857fd14"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:43:11.420704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:43:11.420704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:43:11.434787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-62209ba0-1857-44a8-86b9-d07f6ca4ff2c req-0e9c40a4-12ab-41e0-995f-0e82d9215806 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:11.435655 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-62209ba0-1857-44a8-86b9-d07f6ca4ff2c req-0e9c40a4-12ab-41e0-995f-0e82d9215806 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:11.470051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-62209ba0-1857-44a8-86b9-d07f6ca4ff2c req-0e9c40a4-12ab-41e0-995f-0e82d9215806 service nova] Creating event network-vif-deleted:69add522-0ba4-40f0-900d-61b23857fd14 for instance d5220415-dcff-467b-ab6e-2d51f7e716dc on hv-cinder-73306 Dec 21 04:43:11.478366 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-62209ba0-1857-44a8-86b9-d07f6ca4ff2c req-0e9c40a4-12ab-41e0-995f-0e82d9215806 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075768 Dec 21 04:43:11.481432 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 755/1548] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:43:11 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:43:12.051849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-81118e00-8f55-4ea6-9b29-1cb08a18e9cd tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:12.051849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-81118e00-8f55-4ea6-9b29-1cb08a18e9cd tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:12.059709 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81118e00-8f55-4ea6-9b29-1cb08a18e9cd tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:12.060218 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81118e00-8f55-4ea6-9b29-1cb08a18e9cd tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:12.061046 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81118e00-8f55-4ea6-9b29-1cb08a18e9cd tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:12.061566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81118e00-8f55-4ea6-9b29-1cb08a18e9cd tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:12.141045 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81118e00-8f55-4ea6-9b29-1cb08a18e9cd tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:12.141559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-81118e00-8f55-4ea6-9b29-1cb08a18e9cd tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:12.142067 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.objects.instance [None req-81118e00-8f55-4ea6-9b29-1cb08a18e9cd tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lazy-loading 'fault' on Instance uuid d5220415-dcff-467b-ab6e-2d51f7e716dc {{(pid=94299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 21 04:43:12.210925 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-81118e00-8f55-4ea6-9b29-1cb08a18e9cd tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:12.220025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-81118e00-8f55-4ea6-9b29-1cb08a18e9cd tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 200 len: 1230 microversion: 2.1 time: 0.178004 Dec 21 04:43:12.221524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 794/1549] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:12 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 1230 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:13.244427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9065a73e-4c9d-432d-b756-54651661a8ae tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:13.245184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-9065a73e-4c9d-432d-b756-54651661a8ae tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:13.254856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9065a73e-4c9d-432d-b756-54651661a8ae tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:13.255330 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9065a73e-4c9d-432d-b756-54651661a8ae tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:13.256156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9065a73e-4c9d-432d-b756-54651661a8ae tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:13.256644 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-9065a73e-4c9d-432d-b756-54651661a8ae tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:13.310940 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-9065a73e-4c9d-432d-b756-54651661a8ae tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] HTTP exception thrown: Instance d5220415-dcff-467b-ab6e-2d51f7e716dc could not be found. Dec 21 04:43:13.311615 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-9065a73e-4c9d-432d-b756-54651661a8ae tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Returning 404 to user: Instance d5220415-dcff-467b-ab6e-2d51f7e716dc could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:43:13.312521 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-9065a73e-4c9d-432d-b756-54651661a8ae tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 404 len: 111 microversion: 2.1 time: 0.077983 Dec 21 04:43:13.313136 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 756/1550] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:13 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:43:13.372160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1343372601", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-710794790", "security_groups": [{"name": "tempest-TestVolumeBootPattern-625897284"}], "block_device_mapping_v2": [{"uuid": "ee74b040-1720-49f4-9c78-923d0f1dd69d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d868963-851b-4b8f-95e5-ad6093b907aa"}]}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:43:13.557578 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] validate_networks() for [('6d868963-851b-4b8f-95e5-ad6093b907aa', None, None, None)] {{(pid=94299) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:43:14.444493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Flavor limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:43:14.445700 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Image limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:43:14.446270 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Flavor pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:43:14.446739 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Image pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:43:14.447259 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:43:14.457169 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:14.457679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:14.458549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:14.459091 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:14.481137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Getting quotas for project c9a3b1a5cbe74271b3ec25d419290273. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:43:14.485505 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Getting quotas for user 045cd7a8d06743879fea0de525792bef and project c9a3b1a5cbe74271b3ec25d419290273. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:43:14.595448 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Going to run 1 instances... {{(pid=94299) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:43:14.598493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee74b040-1720-49f4-9c78-923d0f1dd69d',volume_size=None,volume_type=None)] {{(pid=94299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:43:14.775856 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-763607f9-4a60-4a78-962b-9248f280bb53 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 1.413057 Dec 21 04:43:14.776543 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 795/1551] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:43:13 2020] POST /compute/v2.1/servers => generated 412 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 21 04:43:14.792259 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ebd9c035-422e-452d-87a0-b9910ed18bc7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:14.792919 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ebd9c035-422e-452d-87a0-b9910ed18bc7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:14.878885 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ebd9c035-422e-452d-87a0-b9910ed18bc7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:14.886805 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ebd9c035-422e-452d-87a0-b9910ed18bc7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1094 microversion: 2.1 time: 0.103588 Dec 21 04:43:14.887433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 757/1552] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:14 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1094 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 21 04:43:15.910695 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-85708169-818b-447a-8874-475f680362e2 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:15.911361 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-85708169-818b-447a-8874-475f680362e2 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:15.997324 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-85708169-818b-447a-8874-475f680362e2 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:16.005981 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-85708169-818b-447a-8874-475f680362e2 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1094 microversion: 2.1 time: 0.104677 Dec 21 04:43:16.006568 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 796/1553] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:15 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1094 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:17.028976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1920f68c-493e-4599-9f1b-934d0a77cc35 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:17.029653 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1920f68c-493e-4599-9f1b-934d0a77cc35 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:17.121047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1920f68c-493e-4599-9f1b-934d0a77cc35 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:17.130467 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1920f68c-493e-4599-9f1b-934d0a77cc35 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1094 microversion: 2.1 time: 0.110425 Dec 21 04:43:17.131127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 758/1554] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:17 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1094 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:18.153615 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-13b52ea9-62aa-4cf2-baf7-de2fc0ab988b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:18.154277 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-13b52ea9-62aa-4cf2-baf7-de2fc0ab988b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:18.162713 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-13b52ea9-62aa-4cf2-baf7-de2fc0ab988b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:18.163266 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-13b52ea9-62aa-4cf2-baf7-de2fc0ab988b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:18.164099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-13b52ea9-62aa-4cf2-baf7-de2fc0ab988b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:18.164589 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-13b52ea9-62aa-4cf2-baf7-de2fc0ab988b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:18.297139 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-13b52ea9-62aa-4cf2-baf7-de2fc0ab988b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:18.306375 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-13b52ea9-62aa-4cf2-baf7-de2fc0ab988b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1210 microversion: 2.1 time: 0.162191 Dec 21 04:43:18.306999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 797/1555] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:18 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1210 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:19.330339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a5ae1b3f-051d-4e36-8d0d-9d495f0de168 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:19.331100 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a5ae1b3f-051d-4e36-8d0d-9d495f0de168 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:19.339396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5ae1b3f-051d-4e36-8d0d-9d495f0de168 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:19.339910 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5ae1b3f-051d-4e36-8d0d-9d495f0de168 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:19.340757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5ae1b3f-051d-4e36-8d0d-9d495f0de168 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:19.341252 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a5ae1b3f-051d-4e36-8d0d-9d495f0de168 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:19.572178 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a5ae1b3f-051d-4e36-8d0d-9d495f0de168 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:19.581674 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a5ae1b3f-051d-4e36-8d0d-9d495f0de168 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1272 microversion: 2.1 time: 0.260862 Dec 21 04:43:19.582264 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 759/1556] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:19 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:20.527120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-ffc67a93-2765-4f53-9f4e-febc8601a25a req-48e08e2a-4bab-4c9a-815a-18c2725e5008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43046b0-3761-4524-803a-34a3921bac5c", "tag": "614b3321-9772-40bb-a1fe-463f4207a5a9"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:43:20.534718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:43:20.534718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:43:20.544275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-ffc67a93-2765-4f53-9f4e-febc8601a25a req-48e08e2a-4bab-4c9a-815a-18c2725e5008 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:20.544769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-ffc67a93-2765-4f53-9f4e-febc8601a25a req-48e08e2a-4bab-4c9a-815a-18c2725e5008 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:20.562807 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-ffc67a93-2765-4f53-9f4e-febc8601a25a req-48e08e2a-4bab-4c9a-815a-18c2725e5008 service nova] Creating event network-changed:614b3321-9772-40bb-a1fe-463f4207a5a9 for instance b43046b0-3761-4524-803a-34a3921bac5c on hv-cinder-73306 Dec 21 04:43:20.567999 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-ffc67a93-2765-4f53-9f4e-febc8601a25a req-48e08e2a-4bab-4c9a-815a-18c2725e5008 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050662 Dec 21 04:43:20.568797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 798/1557] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:43:20 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:43:20.605725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-1fb76e1d-ace2-4f6a-9b6e-2fbb3fcc0586 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:20.606838 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-1fb76e1d-ace2-4f6a-9b6e-2fbb3fcc0586 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:20.614985 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1fb76e1d-ace2-4f6a-9b6e-2fbb3fcc0586 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:20.615477 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1fb76e1d-ace2-4f6a-9b6e-2fbb3fcc0586 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:20.616339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1fb76e1d-ace2-4f6a-9b6e-2fbb3fcc0586 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:20.616830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-1fb76e1d-ace2-4f6a-9b6e-2fbb3fcc0586 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:20.840908 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-1fb76e1d-ace2-4f6a-9b6e-2fbb3fcc0586 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:20.849716 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-1fb76e1d-ace2-4f6a-9b6e-2fbb3fcc0586 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1272 microversion: 2.1 time: 0.253876 Dec 21 04:43:20.850597 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 760/1558] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:20 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:21.876078 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-98a2b6fe-6599-4e98-a773-51faf61c7e2c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:21.876765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-98a2b6fe-6599-4e98-a773-51faf61c7e2c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:21.886253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-98a2b6fe-6599-4e98-a773-51faf61c7e2c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:21.886758 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-98a2b6fe-6599-4e98-a773-51faf61c7e2c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:21.887630 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-98a2b6fe-6599-4e98-a773-51faf61c7e2c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:21.888120 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-98a2b6fe-6599-4e98-a773-51faf61c7e2c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:22.118535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-98a2b6fe-6599-4e98-a773-51faf61c7e2c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:22.128399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-98a2b6fe-6599-4e98-a773-51faf61c7e2c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1272 microversion: 2.1 time: 0.263030 Dec 21 04:43:22.129152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 799/1559] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:21 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:23.151535 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4f3df4ea-4ba6-4c1c-bf81-e4ad40a1c853 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:23.152204 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4f3df4ea-4ba6-4c1c-bf81-e4ad40a1c853 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:23.160275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f3df4ea-4ba6-4c1c-bf81-e4ad40a1c853 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:23.160785 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f3df4ea-4ba6-4c1c-bf81-e4ad40a1c853 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:23.161616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f3df4ea-4ba6-4c1c-bf81-e4ad40a1c853 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:23.162114 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4f3df4ea-4ba6-4c1c-bf81-e4ad40a1c853 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:23.516470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4f3df4ea-4ba6-4c1c-bf81-e4ad40a1c853 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:23.525285 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4f3df4ea-4ba6-4c1c-bf81-e4ad40a1c853 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1272 microversion: 2.1 time: 0.383385 Dec 21 04:43:23.525886 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 761/1560] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:23 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1272 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:24.548087 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-09545bf5-4ad3-4b6b-9e76-1a1efbb765e6 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:24.548756 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-09545bf5-4ad3-4b6b-9e76-1a1efbb765e6 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:24.556704 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09545bf5-4ad3-4b6b-9e76-1a1efbb765e6 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:24.557206 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09545bf5-4ad3-4b6b-9e76-1a1efbb765e6 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:24.558029 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09545bf5-4ad3-4b6b-9e76-1a1efbb765e6 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:24.558517 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-09545bf5-4ad3-4b6b-9e76-1a1efbb765e6 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:24.774051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-09545bf5-4ad3-4b6b-9e76-1a1efbb765e6 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:24.782806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-09545bf5-4ad3-4b6b-9e76-1a1efbb765e6 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1272 microversion: 2.1 time: 0.243988 Dec 21 04:43:24.783579 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 800/1561] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:24 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:25.805379 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-598411ef-dc00-4740-9cdf-f57482db4ffc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:25.806035 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-598411ef-dc00-4740-9cdf-f57482db4ffc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:25.809661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27fe5106-18ea-44c6-8644-655b910d6119] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 21 04:43:25.816013 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-598411ef-dc00-4740-9cdf-f57482db4ffc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:25.816567 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-598411ef-dc00-4740-9cdf-f57482db4ffc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:25.817409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-598411ef-dc00-4740-9cdf-f57482db4ffc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:25.817904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-598411ef-dc00-4740-9cdf-f57482db4ffc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:26.034824 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-598411ef-dc00-4740-9cdf-f57482db4ffc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:26.043778 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-598411ef-dc00-4740-9cdf-f57482db4ffc tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1272 microversion: 2.1 time: 0.247975 Dec 21 04:43:26.044373 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 762/1562] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:25 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:27.061356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dca63194-cb64-420f-b69a-f6c254fed282] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 21 04:43:27.070721 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-15365eed-b8ae-42fc-b994-8cc9a4f007a8 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:27.071436 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-15365eed-b8ae-42fc-b994-8cc9a4f007a8 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:27.079313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15365eed-b8ae-42fc-b994-8cc9a4f007a8 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:27.079828 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15365eed-b8ae-42fc-b994-8cc9a4f007a8 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:27.080660 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15365eed-b8ae-42fc-b994-8cc9a4f007a8 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:27.081152 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-15365eed-b8ae-42fc-b994-8cc9a4f007a8 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:27.297490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-15365eed-b8ae-42fc-b994-8cc9a4f007a8 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:27.306952 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-15365eed-b8ae-42fc-b994-8cc9a4f007a8 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1272 microversion: 2.1 time: 0.247132 Dec 21 04:43:27.307550 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 801/1563] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:27 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:28.331680 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-2d2f9fc6-4c59-4867-a4d3-7be6861a7ae1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:28.332345 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-2d2f9fc6-4c59-4867-a4d3-7be6861a7ae1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:28.354051 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] [27fe5106-18ea-44c6-8644-655b910d6119] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 47534. Dec 21 04:43:28.361821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d2f9fc6-4c59-4867-a4d3-7be6861a7ae1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:28.362324 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d2f9fc6-4c59-4867-a4d3-7be6861a7ae1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:28.363199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d2f9fc6-4c59-4867-a4d3-7be6861a7ae1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:28.363694 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-2d2f9fc6-4c59-4867-a4d3-7be6861a7ae1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:28.590329 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-adcaa3c9-14cb-4641-b8e6-fa6a66e40160 req-94e6f6e7-a7f5-4022-b1aa-8a91e3570c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43046b0-3761-4524-803a-34a3921bac5c", "name": "network-vif-plugged", "status": "completed", "tag": "614b3321-9772-40bb-a1fe-463f4207a5a9"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:43:28.598565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:43:28.598565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:43:28.604199 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-2d2f9fc6-4c59-4867-a4d3-7be6861a7ae1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:28.617998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-2d2f9fc6-4c59-4867-a4d3-7be6861a7ae1 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1272 microversion: 2.1 time: 0.296291 Dec 21 04:43:28.618830 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 763/1564] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:28 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1272 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:28.622692 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-adcaa3c9-14cb-4641-b8e6-fa6a66e40160 req-94e6f6e7-a7f5-4022-b1aa-8a91e3570c0a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:28.623232 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-adcaa3c9-14cb-4641-b8e6-fa6a66e40160 req-94e6f6e7-a7f5-4022-b1aa-8a91e3570c0a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:28.649288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-adcaa3c9-14cb-4641-b8e6-fa6a66e40160 req-94e6f6e7-a7f5-4022-b1aa-8a91e3570c0a service nova] Creating event network-vif-plugged:614b3321-9772-40bb-a1fe-463f4207a5a9 for instance b43046b0-3761-4524-803a-34a3921bac5c on hv-cinder-73306 Dec 21 04:43:28.656055 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] [dca63194-cb64-420f-b69a-f6c254fed282] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 47538. Dec 21 04:43:28.658757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-adcaa3c9-14cb-4641-b8e6-fa6a66e40160 req-94e6f6e7-a7f5-4022-b1aa-8a91e3570c0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083189 Dec 21 04:43:28.659849 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 802/1565] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:43:28 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:43:29.643868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e84aa509-c142-4377-aa80-9eb432d4008b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:29.644544 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e84aa509-c142-4377-aa80-9eb432d4008b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:29.655831 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e84aa509-c142-4377-aa80-9eb432d4008b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:29.656348 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e84aa509-c142-4377-aa80-9eb432d4008b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:29.657192 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e84aa509-c142-4377-aa80-9eb432d4008b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:29.657696 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e84aa509-c142-4377-aa80-9eb432d4008b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:29.878859 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-e84aa509-c142-4377-aa80-9eb432d4008b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:29.887893 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e84aa509-c142-4377-aa80-9eb432d4008b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1272 microversion: 2.1 time: 0.253970 Dec 21 04:43:29.888488 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 764/1566] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:29 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1272 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:30.912831 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a805e94c-14a3-497f-9b09-0dde12313808 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:30.913598 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a805e94c-14a3-497f-9b09-0dde12313808 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:30.921772 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a805e94c-14a3-497f-9b09-0dde12313808 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:30.922275 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a805e94c-14a3-497f-9b09-0dde12313808 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:30.923127 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a805e94c-14a3-497f-9b09-0dde12313808 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:30.923620 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a805e94c-14a3-497f-9b09-0dde12313808 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:31.141757 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-a805e94c-14a3-497f-9b09-0dde12313808 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:31.151213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a805e94c-14a3-497f-9b09-0dde12313808 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1459 microversion: 2.1 time: 0.248969 Dec 21 04:43:31.151811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 803/1567] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:30 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1459 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:31.173299 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dc6a4d4a-52bb-49e1-8afe-346624225f0b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:43:31.174148 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dc6a4d4a-52bb-49e1-8afe-346624225f0b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:31.181976 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc6a4d4a-52bb-49e1-8afe-346624225f0b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:31.182485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc6a4d4a-52bb-49e1-8afe-346624225f0b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:31.183419 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc6a4d4a-52bb-49e1-8afe-346624225f0b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:31.183911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dc6a4d4a-52bb-49e1-8afe-346624225f0b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:31.402657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dc6a4d4a-52bb-49e1-8afe-346624225f0b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:43:31.411802 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dc6a4d4a-52bb-49e1-8afe-346624225f0b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1459 microversion: 2.1 time: 0.247399 Dec 21 04:43:31.412396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 765/1568] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:43:31 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1459 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:43:31.434418 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-85356b13-0d70-423c-9dcc-0b4a66c01557 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'create', calling method: .version_select at 0x7f2bb842a488>, body: {"pool": null} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:43:33.418635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-85356b13-0d70-423c-9dcc-0b4a66c01557 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.993349 Dec 21 04:43:33.419415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 804/1569] 10.222.0.16 () {60 vars in 1160 bytes} [Mon Dec 21 04:43:31 2020] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:43:33.436107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-f4fba24c-0bba-4804-895d-977ed293359d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.26"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:43:33.437279 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-f4fba24c-0bba-4804-895d-977ed293359d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:43:33.445844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4fba24c-0bba-4804-895d-977ed293359d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:33.446347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4fba24c-0bba-4804-895d-977ed293359d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:33.447200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4fba24c-0bba-4804-895d-977ed293359d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:33.447689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4fba24c-0bba-4804-895d-977ed293359d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:33.523495 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4fba24c-0bba-4804-895d-977ed293359d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Acquired lock "refresh_cache-b43046b0-3761-4524-803a-34a3921bac5c" {{(pid=94298) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 21 04:43:35.389056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-f4fba24c-0bba-4804-895d-977ed293359d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Building network info cache for instance {{(pid=94298) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 21 04:43:35.403767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-b9a4474d-58d9-421e-ae4b-1b15bcadeb43 req-52137c47-a2c8-4706-bd7b-efc6f64218ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43046b0-3761-4524-803a-34a3921bac5c", "tag": "614b3321-9772-40bb-a1fe-463f4207a5a9"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:43:35.411472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:43:35.411472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:43:35.424102 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-b9a4474d-58d9-421e-ae4b-1b15bcadeb43 req-52137c47-a2c8-4706-bd7b-efc6f64218ce service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:43:35.424607 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-b9a4474d-58d9-421e-ae4b-1b15bcadeb43 req-52137c47-a2c8-4706-bd7b-efc6f64218ce service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:43:35.442170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-b9a4474d-58d9-421e-ae4b-1b15bcadeb43 req-52137c47-a2c8-4706-bd7b-efc6f64218ce service nova] Creating event network-changed:614b3321-9772-40bb-a1fe-463f4207a5a9 for instance b43046b0-3761-4524-803a-34a3921bac5c on hv-cinder-73306 Dec 21 04:43:35.447883 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-b9a4474d-58d9-421e-ae4b-1b15bcadeb43 req-52137c47-a2c8-4706-bd7b-efc6f64218ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053374 Dec 21 04:43:35.448810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 805/1570] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:43:35 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:43:36.217104 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-f4fba24c-0bba-4804-895d-977ed293359d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Updating instance_info_cache with network_info: [{"id": "614b3321-9772-40bb-a1fe-463f4207a5a9", "address": "fa:16:3e:68:d0:da", "network": {"id": "6d868963-851b-4b8f-95e5-ad6093b907aa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1252365335-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c9a3b1a5cbe74271b3ec25d419290273", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap614b3321-97", "ovs_interfaceid": "614b3321-9772-40bb-a1fe-463f4207a5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94298) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 21 04:43:36.228339 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-f4fba24c-0bba-4804-895d-977ed293359d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Releasing lock "refresh_cache-b43046b0-3761-4524-803a-34a3921bac5c" {{(pid=94298) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 21 04:43:36.229190 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-f4fba24c-0bba-4804-895d-977ed293359d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c/action" status: 202 len: 0 microversion: 2.1 time: 2.802346 Dec 21 04:43:36.230056 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 766/1571] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:43:33 2020] POST /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c/action => generated 0 bytes in 2804 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 21 04:43:46.239670 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:43:46.240226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:43:46 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:45:10.706576 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-259277456", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-710794790", "security_groups": [{"name": "tempest-TestVolumeBootPattern-625897284"}], "block_device_mapping_v2": [{"uuid": "5df399d8-b611-4c0a-ae52-e91703703735", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d868963-851b-4b8f-95e5-ad6093b907aa"}]}} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:45:10.887641 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] validate_networks() for [('6d868963-851b-4b8f-95e5-ad6093b907aa', None, None, None)] {{(pid=94299) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 21 04:45:11.686726 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Flavor limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 21 04:45:11.687243 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Image limits 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 21 04:45:11.687780 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Flavor pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 21 04:45:11.688233 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Image pref 0:0:0 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 21 04:45:11.688691 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.virt.hardware [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 21 04:45:11.697675 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:11.698172 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:11.699088 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:11.699577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:11.717648 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Getting quotas for project c9a3b1a5cbe74271b3ec25d419290273. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 21 04:45:11.722466 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.quota [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Getting quotas for user 045cd7a8d06743879fea0de525792bef and project c9a3b1a5cbe74271b3ec25d419290273. Resources: {'instances', 'cores', 'ram'} {{(pid=94299) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 21 04:45:11.830869 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Going to run 1 instances... {{(pid=94299) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 21 04:45:11.833420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5df399d8-b611-4c0a-ae52-e91703703735',volume_size=None,volume_type=None)] {{(pid=94299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 21 04:45:12.008750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-86edf252-d38d-4c3e-9b7c-03994d5f627f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 1.312478 Dec 21 04:45:12.009412 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 806/1572] 10.222.0.16 () {60 vars in 1137 bytes} [Mon Dec 21 04:45:10 2020] POST /compute/v2.1/servers => generated 412 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 21 04:45:12.026058 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-524af6b5-310e-48ca-a4d7-d970f4e81105 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:12.026734 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-524af6b5-310e-48ca-a4d7-d970f4e81105 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:12.113977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-524af6b5-310e-48ca-a4d7-d970f4e81105 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:12.122737 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-524af6b5-310e-48ca-a4d7-d970f4e81105 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1093 microversion: 2.1 time: 0.106625 Dec 21 04:45:12.123374 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 767/1573] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:12 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1093 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:13.147632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-dd83d5b0-cc93-44f9-a856-c62e7f040a1c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:13.148313 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-dd83d5b0-cc93-44f9-a856-c62e7f040a1c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:13.157458 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dd83d5b0-cc93-44f9-a856-c62e7f040a1c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:13.157972 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dd83d5b0-cc93-44f9-a856-c62e7f040a1c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:13.158821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dd83d5b0-cc93-44f9-a856-c62e7f040a1c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:13.159353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-dd83d5b0-cc93-44f9-a856-c62e7f040a1c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:13.293708 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-dd83d5b0-cc93-44f9-a856-c62e7f040a1c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:13.302573 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-dd83d5b0-cc93-44f9-a856-c62e7f040a1c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1209 microversion: 2.1 time: 0.165285 Dec 21 04:45:13.303433 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 807/1574] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:13 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1209 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:14.327254 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7f00cc6d-dd2b-449f-9b1b-3f4abe1ae5fa tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:14.328616 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7f00cc6d-dd2b-449f-9b1b-3f4abe1ae5fa tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:14.340138 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f00cc6d-dd2b-449f-9b1b-3f4abe1ae5fa tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:14.341050 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f00cc6d-dd2b-449f-9b1b-3f4abe1ae5fa tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:14.342321 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f00cc6d-dd2b-449f-9b1b-3f4abe1ae5fa tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:14.343391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7f00cc6d-dd2b-449f-9b1b-3f4abe1ae5fa tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:14.573895 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7f00cc6d-dd2b-449f-9b1b-3f4abe1ae5fa tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:14.582815 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7f00cc6d-dd2b-449f-9b1b-3f4abe1ae5fa tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1271 microversion: 2.1 time: 0.265445 Dec 21 04:45:14.583586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 768/1575] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:14 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:15.606429 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-11960f61-eb81-44fb-a38e-422b847c6d8f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:15.607129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-11960f61-eb81-44fb-a38e-422b847c6d8f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:15.615071 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11960f61-eb81-44fb-a38e-422b847c6d8f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:15.615580 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11960f61-eb81-44fb-a38e-422b847c6d8f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:15.616415 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11960f61-eb81-44fb-a38e-422b847c6d8f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:15.616904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-11960f61-eb81-44fb-a38e-422b847c6d8f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:15.779234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-63770751-075c-4651-9e85-730b2eeb8024 req-99af7f70-a433-4483-8601-47476c3b5c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0986762c-dae5-494c-9ef1-603482103687", "tag": "0e2c63a4-88a3-4eb1-82de-ba637ee5cefd"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:45:15.786276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:15.786276 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:45:15.797094 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-63770751-075c-4651-9e85-730b2eeb8024 req-99af7f70-a433-4483-8601-47476c3b5c6a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:15.798420 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-63770751-075c-4651-9e85-730b2eeb8024 req-99af7f70-a433-4483-8601-47476c3b5c6a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:15.817559 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-63770751-075c-4651-9e85-730b2eeb8024 req-99af7f70-a433-4483-8601-47476c3b5c6a service nova] Creating event network-changed:0e2c63a4-88a3-4eb1-82de-ba637ee5cefd for instance 0986762c-dae5-494c-9ef1-603482103687 on hv-cinder-73306 Dec 21 04:45:15.821784 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [req-63770751-075c-4651-9e85-730b2eeb8024 req-99af7f70-a433-4483-8601-47476c3b5c6a service nova] [0b63c612-5b1c-4ca8-b0fb-91d52efefe02] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 21 04:45:15.848196 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-11960f61-eb81-44fb-a38e-422b847c6d8f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:15.857347 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-11960f61-eb81-44fb-a38e-422b847c6d8f tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1271 microversion: 2.1 time: 0.260102 Dec 21 04:45:15.857935 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 808/1576] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:15 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1271 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:16.838501 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [req-63770751-075c-4651-9e85-730b2eeb8024 req-99af7f70-a433-4483-8601-47476c3b5c6a service nova] [0b63c612-5b1c-4ca8-b0fb-91d52efefe02] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 47638. Dec 21 04:45:16.841874 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-63770751-075c-4651-9e85-730b2eeb8024 req-99af7f70-a433-4483-8601-47476c3b5c6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.072499 Dec 21 04:45:16.842566 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 769/1577] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:45:15 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:45:16.882129 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-099a9a04-8428-44a5-a3eb-000cf41eaa3e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:16.882794 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-099a9a04-8428-44a5-a3eb-000cf41eaa3e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:16.890613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-099a9a04-8428-44a5-a3eb-000cf41eaa3e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:16.891170 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-099a9a04-8428-44a5-a3eb-000cf41eaa3e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:16.892636 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-099a9a04-8428-44a5-a3eb-000cf41eaa3e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:16.893121 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-099a9a04-8428-44a5-a3eb-000cf41eaa3e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:17.117446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-099a9a04-8428-44a5-a3eb-000cf41eaa3e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:17.127137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-099a9a04-8428-44a5-a3eb-000cf41eaa3e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1271 microversion: 2.1 time: 0.255206 Dec 21 04:45:17.127740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 809/1578] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:16 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1271 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:18.149945 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-635b0912-71ad-438f-9892-2cd3538bbb0c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:18.150714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-635b0912-71ad-438f-9892-2cd3538bbb0c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:18.158868 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-635b0912-71ad-438f-9892-2cd3538bbb0c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:18.159416 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-635b0912-71ad-438f-9892-2cd3538bbb0c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:18.160248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-635b0912-71ad-438f-9892-2cd3538bbb0c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:18.160741 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-635b0912-71ad-438f-9892-2cd3538bbb0c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:18.384844 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-635b0912-71ad-438f-9892-2cd3538bbb0c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:18.394042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-635b0912-71ad-438f-9892-2cd3538bbb0c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1271 microversion: 2.1 time: 0.253719 Dec 21 04:45:18.394628 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 770/1579] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:18 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:19.417157 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-73d62ca9-09aa-4864-9fe6-27bbc235535d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:19.417714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-73d62ca9-09aa-4864-9fe6-27bbc235535d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:19.425720 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73d62ca9-09aa-4864-9fe6-27bbc235535d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:19.426226 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73d62ca9-09aa-4864-9fe6-27bbc235535d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:19.427111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73d62ca9-09aa-4864-9fe6-27bbc235535d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:19.427609 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-73d62ca9-09aa-4864-9fe6-27bbc235535d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:19.647405 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-73d62ca9-09aa-4864-9fe6-27bbc235535d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:19.656565 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-73d62ca9-09aa-4864-9fe6-27bbc235535d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1271 microversion: 2.1 time: 0.248506 Dec 21 04:45:19.657207 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 810/1580] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:19 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:20.679451 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8bb4411f-6edd-4220-80f1-a4c891f4f132 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:20.680110 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8bb4411f-6edd-4220-80f1-a4c891f4f132 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:20.687962 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8bb4411f-6edd-4220-80f1-a4c891f4f132 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:20.688963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8bb4411f-6edd-4220-80f1-a4c891f4f132 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:20.689873 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8bb4411f-6edd-4220-80f1-a4c891f4f132 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:20.690362 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8bb4411f-6edd-4220-80f1-a4c891f4f132 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:20.903411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-8bb4411f-6edd-4220-80f1-a4c891f4f132 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:20.912221 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8bb4411f-6edd-4220-80f1-a4c891f4f132 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1271 microversion: 2.1 time: 0.242326 Dec 21 04:45:20.912812 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 771/1581] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:20 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:21.935356 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-ae14eb0c-9e24-4494-b9e3-81b0cfb8508c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:21.936025 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-ae14eb0c-9e24-4494-b9e3-81b0cfb8508c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:21.944074 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae14eb0c-9e24-4494-b9e3-81b0cfb8508c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:21.944577 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae14eb0c-9e24-4494-b9e3-81b0cfb8508c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:21.945402 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae14eb0c-9e24-4494-b9e3-81b0cfb8508c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:21.945894 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-ae14eb0c-9e24-4494-b9e3-81b0cfb8508c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:22.162247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-ae14eb0c-9e24-4494-b9e3-81b0cfb8508c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:22.171080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-ae14eb0c-9e24-4494-b9e3-81b0cfb8508c tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1271 microversion: 2.1 time: 0.245058 Dec 21 04:45:22.171671 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 811/1582] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:21 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1271 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:23.194389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-55c32a3c-bcc2-4076-a4ad-9fb812efda32 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:23.195009 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-55c32a3c-bcc2-4076-a4ad-9fb812efda32 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:23.202934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55c32a3c-bcc2-4076-a4ad-9fb812efda32 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:23.203465 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55c32a3c-bcc2-4076-a4ad-9fb812efda32 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:23.204305 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55c32a3c-bcc2-4076-a4ad-9fb812efda32 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:23.204796 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55c32a3c-bcc2-4076-a4ad-9fb812efda32 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:23.432011 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-ed64cca3-8f0c-4b95-b8ad-f87579aa1113 req-9424b199-bb65-4311-8024-6cdb7b3b0e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0986762c-dae5-494c-9ef1-603482103687", "name": "network-vif-plugged", "status": "completed", "tag": "0e2c63a4-88a3-4eb1-82de-ba637ee5cefd"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:45:23.447334 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-55c32a3c-bcc2-4076-a4ad-9fb812efda32 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:23.449917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:23.449917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:45:23.461470 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-ed64cca3-8f0c-4b95-b8ad-f87579aa1113 req-9424b199-bb65-4311-8024-6cdb7b3b0e64 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:23.462248 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-ed64cca3-8f0c-4b95-b8ad-f87579aa1113 req-9424b199-bb65-4311-8024-6cdb7b3b0e64 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:23.463341 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-55c32a3c-bcc2-4076-a4ad-9fb812efda32 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1271 microversion: 2.1 time: 0.277105 Dec 21 04:45:23.463968 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 772/1583] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:23 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:23.485490 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-ed64cca3-8f0c-4b95-b8ad-f87579aa1113 req-9424b199-bb65-4311-8024-6cdb7b3b0e64 service nova] Creating event network-vif-plugged:0e2c63a4-88a3-4eb1-82de-ba637ee5cefd for instance 0986762c-dae5-494c-9ef1-603482103687 on hv-cinder-73306 Dec 21 04:45:23.491916 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-ed64cca3-8f0c-4b95-b8ad-f87579aa1113 req-9424b199-bb65-4311-8024-6cdb7b3b0e64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069674 Dec 21 04:45:23.492876 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 812/1584] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:45:23 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:45:24.488472 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-0ee24f97-6584-4f01-8b7f-c6c161869bb2 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:24.489140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-0ee24f97-6584-4f01-8b7f-c6c161869bb2 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:24.497033 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ee24f97-6584-4f01-8b7f-c6c161869bb2 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:24.497586 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ee24f97-6584-4f01-8b7f-c6c161869bb2 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:24.498421 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ee24f97-6584-4f01-8b7f-c6c161869bb2 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:24.498938 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-0ee24f97-6584-4f01-8b7f-c6c161869bb2 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:24.715180 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-0ee24f97-6584-4f01-8b7f-c6c161869bb2 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:24.724485 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-0ee24f97-6584-4f01-8b7f-c6c161869bb2 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1271 microversion: 2.1 time: 0.245964 Dec 21 04:45:24.725080 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 773/1585] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:24 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:25.748273 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-49da17a8-d9ed-49a5-9fb7-6f6a84ffbe35 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:25.749036 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-49da17a8-d9ed-49a5-9fb7-6f6a84ffbe35 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:25.758131 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49da17a8-d9ed-49a5-9fb7-6f6a84ffbe35 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:25.758635 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49da17a8-d9ed-49a5-9fb7-6f6a84ffbe35 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:25.759493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49da17a8-d9ed-49a5-9fb7-6f6a84ffbe35 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:25.759983 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-49da17a8-d9ed-49a5-9fb7-6f6a84ffbe35 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:25.977063 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-49da17a8-d9ed-49a5-9fb7-6f6a84ffbe35 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:25.986776 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-49da17a8-d9ed-49a5-9fb7-6f6a84ffbe35 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1459 microversion: 2.1 time: 0.248226 Dec 21 04:45:25.987401 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 813/1586] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:25 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1459 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:26.009427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-55daa2f8-b2ca-4525-8551-3723d997a7c9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:45:26.010024 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-55daa2f8-b2ca-4525-8551-3723d997a7c9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:26.017997 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55daa2f8-b2ca-4525-8551-3723d997a7c9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:26.018493 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55daa2f8-b2ca-4525-8551-3723d997a7c9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:26.019365 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55daa2f8-b2ca-4525-8551-3723d997a7c9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:26.019860 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-55daa2f8-b2ca-4525-8551-3723d997a7c9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:26.236522 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-55daa2f8-b2ca-4525-8551-3723d997a7c9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:45:26.245397 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-55daa2f8-b2ca-4525-8551-3723d997a7c9 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1459 microversion: 2.1 time: 0.245533 Dec 21 04:45:26.245998 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 774/1587] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:45:25 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1459 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:45:26.269106 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b3840e0e-b91b-443b-bab5-b4c964e1b6a8 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'create', calling method: .version_select at 0x7f2bb84ef1e0>, body: {"pool": null} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:45:28.309446 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b3840e0e-b91b-443b-bab5-b4c964e1b6a8 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.049872 Dec 21 04:45:28.310107 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 814/1588] 10.222.0.16 () {60 vars in 1160 bytes} [Mon Dec 21 04:45:26 2020] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:45:28.327382 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8820cda0-1239-431a-992e-ed375c9893ef tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.147"}} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:45:28.328603 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8820cda0-1239-431a-992e-ed375c9893ef tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:45:28.337191 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8820cda0-1239-431a-992e-ed375c9893ef tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:28.337701 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8820cda0-1239-431a-992e-ed375c9893ef tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:28.338538 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8820cda0-1239-431a-992e-ed375c9893ef tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:28.339059 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8820cda0-1239-431a-992e-ed375c9893ef tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:28.408425 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8820cda0-1239-431a-992e-ed375c9893ef tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Acquired lock "refresh_cache-0986762c-dae5-494c-9ef1-603482103687" {{(pid=94298) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 21 04:45:30.365075 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-8820cda0-1239-431a-992e-ed375c9893ef tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Building network info cache for instance {{(pid=94298) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 21 04:45:30.379499 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-3e146985-c0e7-4d82-b1e5-f2a3f5172b7e req-b66462ba-f286-449e-b40c-c110a5b5af9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0986762c-dae5-494c-9ef1-603482103687", "tag": "0e2c63a4-88a3-4eb1-82de-ba637ee5cefd"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:45:30.387156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:30.387156 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:45:30.396977 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-3e146985-c0e7-4d82-b1e5-f2a3f5172b7e req-b66462ba-f286-449e-b40c-c110a5b5af9d service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:45:30.397487 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-3e146985-c0e7-4d82-b1e5-f2a3f5172b7e req-b66462ba-f286-449e-b40c-c110a5b5af9d service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:45:30.415509 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-3e146985-c0e7-4d82-b1e5-f2a3f5172b7e req-b66462ba-f286-449e-b40c-c110a5b5af9d service nova] Creating event network-changed:0e2c63a4-88a3-4eb1-82de-ba637ee5cefd for instance 0986762c-dae5-494c-9ef1-603482103687 on hv-cinder-73306 Dec 21 04:45:30.420917 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-3e146985-c0e7-4d82-b1e5-f2a3f5172b7e req-b66462ba-f286-449e-b40c-c110a5b5af9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050937 Dec 21 04:45:30.421857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 815/1589] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:45:30 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:45:31.191837 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-8820cda0-1239-431a-992e-ed375c9893ef tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Updating instance_info_cache with network_info: [{"id": "0e2c63a4-88a3-4eb1-82de-ba637ee5cefd", "address": "fa:16:3e:85:b4:de", "network": {"id": "6d868963-851b-4b8f-95e5-ad6093b907aa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1252365335-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c9a3b1a5cbe74271b3ec25d419290273", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap0e2c63a4-88", "ovs_interfaceid": "0e2c63a4-88a3-4eb1-82de-ba637ee5cefd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94298) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 21 04:45:31.203017 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8820cda0-1239-431a-992e-ed375c9893ef tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Releasing lock "refresh_cache-0986762c-dae5-494c-9ef1-603482103687" {{(pid=94298) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 21 04:45:31.204698 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8820cda0-1239-431a-992e-ed375c9893ef tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "POST /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687/action" status: 202 len: 0 microversion: 2.1 time: 2.886151 Dec 21 04:45:31.215738 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 775/1590] 10.222.0.16 () {60 vars in 1268 bytes} [Mon Dec 21 04:45:28 2020] POST /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687/action => generated 0 bytes in 2888 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 21 04:45:46.179181 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:45:46.179787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:45:46 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:45:46.567625 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:45:46.567811 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:45:46 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:47:00.192230 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dca63194-cb64-420f-b69a-f6c254fed282] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 21 04:47:00.302929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-d3bb103d-c493-4a72-bd21-180135bde5f7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '.version_select at 0x7f2bb842ab70>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:00.788140 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-d3bb103d-c493-4a72-bd21-180135bde5f7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:00.796441 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3bb103d-c493-4a72-bd21-180135bde5f7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:00.796953 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3bb103d-c493-4a72-bd21-180135bde5f7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:00.797799 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3bb103d-c493-4a72-bd21-180135bde5f7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:00.798293 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3bb103d-c493-4a72-bd21-180135bde5f7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:00.861514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3bb103d-c493-4a72-bd21-180135bde5f7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Acquired lock "refresh_cache-0986762c-dae5-494c-9ef1-603482103687" {{(pid=94299) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 21 04:47:01.213767 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] [dca63194-cb64-420f-b69a-f6c254fed282] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 47700. Dec 21 04:47:02.759354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-d3bb103d-c493-4a72-bd21-180135bde5f7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Building network info cache for instance {{(pid=94299) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 21 04:47:02.770184 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27fe5106-18ea-44c6-8644-655b910d6119] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 21 04:47:02.855754 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-4d052bed-c3fa-4b4e-b34f-358fadc27595 req-8edbe026-f74e-4928-bae8-d6d955d0fe30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0986762c-dae5-494c-9ef1-603482103687", "tag": "0e2c63a4-88a3-4eb1-82de-ba637ee5cefd"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:47:02.862526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:47:02.862526 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:47:02.872200 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-4d052bed-c3fa-4b4e-b34f-358fadc27595 req-8edbe026-f74e-4928-bae8-d6d955d0fe30 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:02.872707 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-4d052bed-c3fa-4b4e-b34f-358fadc27595 req-8edbe026-f74e-4928-bae8-d6d955d0fe30 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:02.890638 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-4d052bed-c3fa-4b4e-b34f-358fadc27595 req-8edbe026-f74e-4928-bae8-d6d955d0fe30 service nova] Creating event network-changed:0e2c63a4-88a3-4eb1-82de-ba637ee5cefd for instance 0986762c-dae5-494c-9ef1-603482103687 on hv-cinder-73306 Dec 21 04:47:02.897076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-4d052bed-c3fa-4b4e-b34f-358fadc27595 req-8edbe026-f74e-4928-bae8-d6d955d0fe30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132566 Dec 21 04:47:02.898195 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 776/1591] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:47:02 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:47:03.554835 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-d3bb103d-c493-4a72-bd21-180135bde5f7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Updating instance_info_cache with network_info: [{"id": "0e2c63a4-88a3-4eb1-82de-ba637ee5cefd", "address": "fa:16:3e:85:b4:de", "network": {"id": "6d868963-851b-4b8f-95e5-ad6093b907aa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1252365335-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c9a3b1a5cbe74271b3ec25d419290273", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap0e2c63a4-88", "ovs_interfaceid": "0e2c63a4-88a3-4eb1-82de-ba637ee5cefd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94299) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 21 04:47:03.568242 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-d3bb103d-c493-4a72-bd21-180135bde5f7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Releasing lock "refresh_cache-0986762c-dae5-494c-9ef1-603482103687" {{(pid=94299) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 21 04:47:03.569198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-d3bb103d-c493-4a72-bd21-180135bde5f7 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/09fed68e-3627-414e-b2b0-e694b3aec38d" status: 202 len: 0 microversion: 2.1 time: 3.382792 Dec 21 04:47:03.570069 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 816/1592] 10.222.0.16 () {58 vars in 1253 bytes} [Mon Dec 21 04:47:00 2020] DELETE /compute/v2.1/os-floating-ips/09fed68e-3627-414e-b2b0-e694b3aec38d => generated 0 bytes in 3384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:47:03.584987 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-8f489568-1d95-49fc-945b-3aac0a98a55b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:03.585650 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8f489568-1d95-49fc-945b-3aac0a98a55b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:03.594171 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f489568-1d95-49fc-945b-3aac0a98a55b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:03.594681 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f489568-1d95-49fc-945b-3aac0a98a55b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:03.595549 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f489568-1d95-49fc-945b-3aac0a98a55b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:03.596049 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-8f489568-1d95-49fc-945b-3aac0a98a55b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:03.671213 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-8f489568-1d95-49fc-945b-3aac0a98a55b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Going to try to terminate instance {{(pid=94298) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:47:03.803099 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] [27fe5106-18ea-44c6-8644-655b910d6119] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 47708. Dec 21 04:47:03.807815 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-8f489568-1d95-49fc-945b-3aac0a98a55b tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "DELETE /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 204 len: 0 microversion: 2.1 time: 0.232867 Dec 21 04:47:03.808457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 777/1593] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:47:03 2020] DELETE /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:47:03.822956 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-18736d04-4f7e-45d3-ad5e-983a7f985a14 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:03.823637 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-18736d04-4f7e-45d3-ad5e-983a7f985a14 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:03.831476 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18736d04-4f7e-45d3-ad5e-983a7f985a14 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:03.832228 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18736d04-4f7e-45d3-ad5e-983a7f985a14 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:03.833060 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18736d04-4f7e-45d3-ad5e-983a7f985a14 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:03.833545 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-18736d04-4f7e-45d3-ad5e-983a7f985a14 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:04.071759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-18736d04-4f7e-45d3-ad5e-983a7f985a14 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:47:04.080857 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-18736d04-4f7e-45d3-ad5e-983a7f985a14 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1465 microversion: 2.1 time: 0.267770 Dec 21 04:47:04.081689 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 817/1594] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:47:03 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1465 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:47:05.106234 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-69217368-126e-440c-bcb5-8aaadeff6871 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:05.107026 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-69217368-126e-440c-bcb5-8aaadeff6871 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:05.115297 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69217368-126e-440c-bcb5-8aaadeff6871 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:05.115810 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69217368-126e-440c-bcb5-8aaadeff6871 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:05.116629 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69217368-126e-440c-bcb5-8aaadeff6871 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:05.117142 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-69217368-126e-440c-bcb5-8aaadeff6871 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:05.335247 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-69217368-126e-440c-bcb5-8aaadeff6871 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:47:05.344066 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-69217368-126e-440c-bcb5-8aaadeff6871 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1465 microversion: 2.1 time: 0.247443 Dec 21 04:47:05.344661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 778/1595] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:47:05 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1465 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:47:05.819744 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-8e80ed44-09c8-4983-9fed-703d45827c02 req-ed812440-8b2e-4e8c-9055-93895f8b52e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0986762c-dae5-494c-9ef1-603482103687", "name": "network-vif-unplugged", "status": "completed", "tag": "0e2c63a4-88a3-4eb1-82de-ba637ee5cefd"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:47:05.826736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:47:05.826736 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:47:05.836417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-8e80ed44-09c8-4983-9fed-703d45827c02 req-ed812440-8b2e-4e8c-9055-93895f8b52e2 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:05.836921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-8e80ed44-09c8-4983-9fed-703d45827c02 req-ed812440-8b2e-4e8c-9055-93895f8b52e2 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:05.855112 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-8e80ed44-09c8-4983-9fed-703d45827c02 req-ed812440-8b2e-4e8c-9055-93895f8b52e2 service nova] Creating event network-vif-unplugged:0e2c63a4-88a3-4eb1-82de-ba637ee5cefd for instance 0986762c-dae5-494c-9ef1-603482103687 on hv-cinder-73306 Dec 21 04:47:05.860306 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-8e80ed44-09c8-4983-9fed-703d45827c02 req-ed812440-8b2e-4e8c-9055-93895f8b52e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134856 Dec 21 04:47:05.860950 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 818/1596] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:47:05 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:47:06.257417 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:47:06.257926 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:47:06 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:47:06.367426 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-b5779c3c-84f4-49ec-8695-f1cccaee9401 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:06.368092 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-b5779c3c-84f4-49ec-8695-f1cccaee9401 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:06.375989 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b5779c3c-84f4-49ec-8695-f1cccaee9401 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:06.376524 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b5779c3c-84f4-49ec-8695-f1cccaee9401 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:06.377599 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b5779c3c-84f4-49ec-8695-f1cccaee9401 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:06.378095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-b5779c3c-84f4-49ec-8695-f1cccaee9401 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:06.599430 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-b5779c3c-84f4-49ec-8695-f1cccaee9401 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:47:06.608304 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-b5779c3c-84f4-49ec-8695-f1cccaee9401 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1465 microversion: 2.1 time: 0.250403 Dec 21 04:47:06.608897 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 779/1597] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:47:06 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1465 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:47:07.406991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-dbc0fd23-cb19-4b71-b07e-399baf622fd5 req-36c44d9a-23aa-48dd-9c61-587079083e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0986762c-dae5-494c-9ef1-603482103687", "name": "network-vif-deleted", "tag": "0e2c63a4-88a3-4eb1-82de-ba637ee5cefd"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:47:07.414679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:47:07.414679 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:47:07.423934 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-dbc0fd23-cb19-4b71-b07e-399baf622fd5 req-36c44d9a-23aa-48dd-9c61-587079083e3b service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:07.424456 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-dbc0fd23-cb19-4b71-b07e-399baf622fd5 req-36c44d9a-23aa-48dd-9c61-587079083e3b service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:07.442657 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-dbc0fd23-cb19-4b71-b07e-399baf622fd5 req-36c44d9a-23aa-48dd-9c61-587079083e3b service nova] Creating event network-vif-deleted:0e2c63a4-88a3-4eb1-82de-ba637ee5cefd for instance 0986762c-dae5-494c-9ef1-603482103687 on hv-cinder-73306 Dec 21 04:47:07.447411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-dbc0fd23-cb19-4b71-b07e-399baf622fd5 req-36c44d9a-23aa-48dd-9c61-587079083e3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136209 Dec 21 04:47:07.448118 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 819/1598] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:47:07 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:47:07.633921 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-4b331fd1-b285-462c-953a-2c869e73c9af tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:07.634595 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-4b331fd1-b285-462c-953a-2c869e73c9af tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:07.642714 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b331fd1-b285-462c-953a-2c869e73c9af tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:07.643292 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b331fd1-b285-462c-953a-2c869e73c9af tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:07.644141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b331fd1-b285-462c-953a-2c869e73c9af tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:07.644928 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-4b331fd1-b285-462c-953a-2c869e73c9af tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:07.788533 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-4b331fd1-b285-462c-953a-2c869e73c9af tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:47:07.797703 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-4b331fd1-b285-462c-953a-2c869e73c9af tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 200 len: 1224 microversion: 2.1 time: 0.173950 Dec 21 04:47:07.798298 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 780/1599] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:47:07 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 1224 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:47:08.822353 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e01d41fc-d01e-4d75-afc8-de4db195881d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:08.823141 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-e01d41fc-d01e-4d75-afc8-de4db195881d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: 0986762c-dae5-494c-9ef1-603482103687] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:08.831198 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e01d41fc-d01e-4d75-afc8-de4db195881d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:08.832391 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e01d41fc-d01e-4d75-afc8-de4db195881d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:08.833211 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e01d41fc-d01e-4d75-afc8-de4db195881d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:08.833827 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-e01d41fc-d01e-4d75-afc8-de4db195881d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:08.886733 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-e01d41fc-d01e-4d75-afc8-de4db195881d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] HTTP exception thrown: Instance 0986762c-dae5-494c-9ef1-603482103687 could not be found. Dec 21 04:47:08.887409 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-e01d41fc-d01e-4d75-afc8-de4db195881d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Returning 404 to user: Instance 0986762c-dae5-494c-9ef1-603482103687 could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:47:08.888290 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-e01d41fc-d01e-4d75-afc8-de4db195881d tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687" status: 404 len: 111 microversion: 2.1 time: 0.076225 Dec 21 04:47:08.888881 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 820/1600] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:47:08 2020] GET /compute/v2.1/servers/0986762c-dae5-494c-9ef1-603482103687 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:47:11.318378 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-a0f0083c-8456-41d9-ae94-07e52a5fb43e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '.version_select at 0x7f2bb86218c8>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:12.059911 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-a0f0083c-8456-41d9-ae94-07e52a5fb43e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:12.069284 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0f0083c-8456-41d9-ae94-07e52a5fb43e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:12.069787 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0f0083c-8456-41d9-ae94-07e52a5fb43e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:12.070632 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0f0083c-8456-41d9-ae94-07e52a5fb43e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:12.071154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0f0083c-8456-41d9-ae94-07e52a5fb43e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:12.132751 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0f0083c-8456-41d9-ae94-07e52a5fb43e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Acquired lock "refresh_cache-b43046b0-3761-4524-803a-34a3921bac5c" {{(pid=94298) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 21 04:47:13.768154 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-a0f0083c-8456-41d9-ae94-07e52a5fb43e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Building network info cache for instance {{(pid=94298) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 21 04:47:13.783611 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-590f1628-640d-4619-989e-3fc5129c918e req-0e5783ba-fbd0-4156-a521-9990146f2d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43046b0-3761-4524-803a-34a3921bac5c", "tag": "614b3321-9772-40bb-a1fe-463f4207a5a9"}]} {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:47:13.791389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:47:13.791389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:47:13.800663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-590f1628-640d-4619-989e-3fc5129c918e req-0e5783ba-fbd0-4156-a521-9990146f2d99 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:13.801164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-590f1628-640d-4619-989e-3fc5129c918e req-0e5783ba-fbd0-4156-a521-9990146f2d99 service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:13.819515 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-590f1628-640d-4619-989e-3fc5129c918e req-0e5783ba-fbd0-4156-a521-9990146f2d99 service nova] Creating event network-changed:614b3321-9772-40bb-a1fe-463f4207a5a9 for instance b43046b0-3761-4524-803a-34a3921bac5c on hv-cinder-73306 Dec 21 04:47:13.824991 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-590f1628-640d-4619-989e-3fc5129c918e req-0e5783ba-fbd0-4156-a521-9990146f2d99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050499 Dec 21 04:47:13.825622 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 821/1601] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:47:13 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 21 04:47:14.912931 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.network.neutron [None req-a0f0083c-8456-41d9-ae94-07e52a5fb43e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Updating instance_info_cache with network_info: [{"id": "614b3321-9772-40bb-a1fe-463f4207a5a9", "address": "fa:16:3e:68:d0:da", "network": {"id": "6d868963-851b-4b8f-95e5-ad6093b907aa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1252365335-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c9a3b1a5cbe74271b3ec25d419290273", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap614b3321-97", "ovs_interfaceid": "614b3321-9772-40bb-a1fe-463f4207a5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94298) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 21 04:47:14.923224 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-a0f0083c-8456-41d9-ae94-07e52a5fb43e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Releasing lock "refresh_cache-b43046b0-3761-4524-803a-34a3921bac5c" {{(pid=94298) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 21 04:47:14.924216 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-a0f0083c-8456-41d9-ae94-07e52a5fb43e tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/cb972825-61a5-44ed-8293-ffd0669f65fb" status: 202 len: 0 microversion: 2.1 time: 3.614946 Dec 21 04:47:14.924880 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 781/1602] 10.222.0.16 () {58 vars in 1253 bytes} [Mon Dec 21 04:47:11 2020] DELETE /compute/v2.1/os-floating-ips/cb972825-61a5-44ed-8293-ffd0669f65fb => generated 0 bytes in 3616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:47:14.939424 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-58d3d9b8-eb7e-415e-afad-f3e401d44b62 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:14.940076 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-58d3d9b8-eb7e-415e-afad-f3e401d44b62 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:14.948750 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58d3d9b8-eb7e-415e-afad-f3e401d44b62 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:14.949292 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58d3d9b8-eb7e-415e-afad-f3e401d44b62 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:14.950164 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58d3d9b8-eb7e-415e-afad-f3e401d44b62 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:14.950661 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-58d3d9b8-eb7e-415e-afad-f3e401d44b62 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:15.022380 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-58d3d9b8-eb7e-415e-afad-f3e401d44b62 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Going to try to terminate instance {{(pid=94299) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 21 04:47:15.143257 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-58d3d9b8-eb7e-415e-afad-f3e401d44b62 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "DELETE /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 204 len: 0 microversion: 2.1 time: 0.213237 Dec 21 04:47:15.144634 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 822/1603] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:47:14 2020] DELETE /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 21 04:47:15.158396 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-27fd82f1-7a61-4817-a876-1f5e6f1be603 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:15.159111 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-27fd82f1-7a61-4817-a876-1f5e6f1be603 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:15.167878 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-27fd82f1-7a61-4817-a876-1f5e6f1be603 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:15.168392 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-27fd82f1-7a61-4817-a876-1f5e6f1be603 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:15.169229 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-27fd82f1-7a61-4817-a876-1f5e6f1be603 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:15.169725 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-27fd82f1-7a61-4817-a876-1f5e6f1be603 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:15.414160 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-27fd82f1-7a61-4817-a876-1f5e6f1be603 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94298) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:47:15.423137 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-27fd82f1-7a61-4817-a876-1f5e6f1be603 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1465 microversion: 2.1 time: 0.273772 Dec 21 04:47:15.423718 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 782/1604] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:47:15 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1465 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:47:16.447444 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-c7d11774-678b-4791-b40d-f70b1e0d6d26 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:16.448318 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-c7d11774-678b-4791-b40d-f70b1e0d6d26 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:16.456289 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7d11774-678b-4791-b40d-f70b1e0d6d26 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:16.457427 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7d11774-678b-4791-b40d-f70b1e0d6d26 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:16.458267 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7d11774-678b-4791-b40d-f70b1e0d6d26 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:16.458759 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-c7d11774-678b-4791-b40d-f70b1e0d6d26 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:16.673455 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-c7d11774-678b-4791-b40d-f70b1e0d6d26 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:47:16.682806 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-c7d11774-678b-4791-b40d-f70b1e0d6d26 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1465 microversion: 2.1 time: 0.245155 Dec 21 04:47:16.683486 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 823/1605] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:47:16 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1465 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:47:17.661572 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [req-c2401f51-4d66-43e7-8177-2e47731d6873 req-687b6427-24cd-43ad-aeab-f39a80f0e33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43046b0-3761-4524-803a-34a3921bac5c", "name": "network-vif-deleted", "tag": "614b3321-9772-40bb-a1fe-463f4207a5a9"}]} {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 21 04:47:17.668457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:47:17.668457 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: warnings.warn(msg) Dec 21 04:47:17.677662 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-c2401f51-4d66-43e7-8177-2e47731d6873 req-687b6427-24cd-43ad-aeab-f39a80f0e33a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:17.678194 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [req-c2401f51-4d66-43e7-8177-2e47731d6873 req-687b6427-24cd-43ad-aeab-f39a80f0e33a service nova] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:17.696963 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.compute.server_external_events [req-c2401f51-4d66-43e7-8177-2e47731d6873 req-687b6427-24cd-43ad-aeab-f39a80f0e33a service nova] Creating event network-vif-deleted:614b3321-9772-40bb-a1fe-463f4207a5a9 for instance b43046b0-3761-4524-803a-34a3921bac5c on hv-cinder-73306 Dec 21 04:47:17.702047 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [req-c2401f51-4d66-43e7-8177-2e47731d6873 req-687b6427-24cd-43ad-aeab-f39a80f0e33a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049747 Dec 21 04:47:17.702797 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 783/1606] 10.222.0.16 () {64 vars in 1308 bytes} [Mon Dec 21 04:47:17 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 21 04:47:17.707915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-7e8fd070-ff44-4124-9506-11ac5b622add tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:17.708592 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-7e8fd070-ff44-4124-9506-11ac5b622add tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:17.716560 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e8fd070-ff44-4124-9506-11ac5b622add tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:17.717068 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e8fd070-ff44-4124-9506-11ac5b622add tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:17.717904 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e8fd070-ff44-4124-9506-11ac5b622add tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:17.718394 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-7e8fd070-ff44-4124-9506-11ac5b622add tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:17.852288 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.policy [None req-7e8fd070-ff44-4124-9506-11ac5b622add tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045cd7a8d06743879fea0de525792bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a3b1a5cbe74271b3ec25d419290273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94299) authorize /opt/stack/nova/nova/policy.py:225}} Dec 21 04:47:17.861177 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-7e8fd070-ff44-4124-9506-11ac5b622add tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 200 len: 1225 microversion: 2.1 time: 0.163503 Dec 21 04:47:17.861769 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 824/1607] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:47:17 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 1225 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 21 04:47:18.886031 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cb59d715-c3b1-4e9d-8ef1-500bdc014bd4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:18.886793 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-cb59d715-c3b1-4e9d-8ef1-500bdc014bd4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: b43046b0-3761-4524-803a-34a3921bac5c] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:18.894821 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cb59d715-c3b1-4e9d-8ef1-500bdc014bd4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:18.895863 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cb59d715-c3b1-4e9d-8ef1-500bdc014bd4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:18.896865 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cb59d715-c3b1-4e9d-8ef1-500bdc014bd4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:18.897354 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-cb59d715-c3b1-4e9d-8ef1-500bdc014bd4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:18.950095 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-cb59d715-c3b1-4e9d-8ef1-500bdc014bd4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] HTTP exception thrown: Instance b43046b0-3761-4524-803a-34a3921bac5c could not be found. Dec 21 04:47:18.950740 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-cb59d715-c3b1-4e9d-8ef1-500bdc014bd4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Returning 404 to user: Instance b43046b0-3761-4524-803a-34a3921bac5c could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:47:18.951668 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-cb59d715-c3b1-4e9d-8ef1-500bdc014bd4 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c" status: 404 len: 111 microversion: 2.1 time: 0.075468 Dec 21 04:47:18.952253 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 784/1608] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:47:18 2020] GET /compute/v2.1/servers/b43046b0-3761-4524-803a-34a3921bac5c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:47:18.966743 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-225b6d99-7e5c-4949-ba75-416721847dc0 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '.version_select at 0x7f2bb842a400>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:20.282018 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-225b6d99-7e5c-4949-ba75-416721847dc0 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/bc9ca974-3d18-4a28-93f2-7b4c7cc9aa4f" status: 202 len: 0 microversion: 2.1 time: 1.324892 Dec 21 04:47:20.282663 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 825/1609] 10.222.0.16 () {58 vars in 1253 bytes} [Mon Dec 21 04:47:18 2020] DELETE /compute/v2.1/os-floating-ips/bc9ca974-3d18-4a28-93f2-7b4c7cc9aa4f => generated 0 bytes in 1326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:47:20.296984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-38d015e7-99d3-48bd-ad27-a33c0a212993 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:20.297551 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-38d015e7-99d3-48bd-ad27-a33c0a212993 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94298) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:20.305399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-38d015e7-99d3-48bd-ad27-a33c0a212993 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:20.305915 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-38d015e7-99d3-48bd-ad27-a33c0a212993 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:20.306749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-38d015e7-99d3-48bd-ad27-a33c0a212993 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:20.307278 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-38d015e7-99d3-48bd-ad27-a33c0a212993 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94298) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:20.359845 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-38d015e7-99d3-48bd-ad27-a33c0a212993 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] HTTP exception thrown: Instance d5220415-dcff-467b-ab6e-2d51f7e716dc could not be found. Dec 21 04:47:20.360504 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-38d015e7-99d3-48bd-ad27-a33c0a212993 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Returning 404 to user: Instance d5220415-dcff-467b-ab6e-2d51f7e716dc could not be found. {{(pid=94298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:47:20.361399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-38d015e7-99d3-48bd-ad27-a33c0a212993 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "DELETE /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 404 len: 111 microversion: 2.1 time: 0.073595 Dec 21 04:47:20.361984 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 785/1610] 10.222.0.16 () {58 vars in 1229 bytes} [Mon Dec 21 04:47:20 2020] DELETE /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:47:20.375613 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-818abfa6-beb4-490e-9d7a-7ed1eb709270 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:20.376282 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.compute.api [None req-818abfa6-beb4-490e-9d7a-7ed1eb709270 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] [instance: d5220415-dcff-467b-ab6e-2d51f7e716dc] Fetching instance by UUID {{(pid=94299) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 21 04:47:20.384514 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-818abfa6-beb4-490e-9d7a-7ed1eb709270 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:20.385021 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-818abfa6-beb4-490e-9d7a-7ed1eb709270 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:20.385842 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-818abfa6-beb4-490e-9d7a-7ed1eb709270 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 21 04:47:20.386335 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG oslo_concurrency.lockutils [None req-818abfa6-beb4-490e-9d7a-7ed1eb709270 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Lock "13ce7efe-25d0-4763-8e8a-03d9c565bf27" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94299) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 21 04:47:20.441986 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.wsgi [None req-818abfa6-beb4-490e-9d7a-7ed1eb709270 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] HTTP exception thrown: Instance d5220415-dcff-467b-ab6e-2d51f7e716dc could not be found. Dec 21 04:47:20.443306 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-818abfa6-beb4-490e-9d7a-7ed1eb709270 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Returning 404 to user: Instance d5220415-dcff-467b-ab6e-2d51f7e716dc could not be found. {{(pid=94299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 21 04:47:20.444208 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-818abfa6-beb4-490e-9d7a-7ed1eb709270 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc" status: 404 len: 111 microversion: 2.1 time: 0.077602 Dec 21 04:47:20.445004 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 826/1611] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Dec 21 04:47:20 2020] GET /compute/v2.1/servers/d5220415-dcff-467b-ab6e-2d51f7e716dc => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 21 04:47:21.699749 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-84bf76d9-dfab-403a-9af0-c60958ca6038 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '.version_select at 0x7f2bb86217b8>' {{(pid=94298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:21.953964 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-84bf76d9-dfab-403a-9af0-c60958ca6038 tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/6fede065-0892-41d0-bb3a-d0f335bafeea" status: 202 len: 0 microversion: 2.1 time: 0.263398 Dec 21 04:47:21.954602 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94298|app: 0|req: 786/1612] 10.222.0.16 () {58 vars in 1262 bytes} [Mon Dec 21 04:47:21 2020] DELETE /compute/v2.1/os-security-groups/6fede065-0892-41d0-bb3a-d0f335bafeea => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:47:21.968969 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: DEBUG nova.api.openstack.wsgi [None req-363951a5-33c3-47fe-9620-b8e29558794a tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] Calling method '.version_select at 0x7f2bb84eff28>' {{(pid=94299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 21 04:47:21.992853 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO nova.api.openstack.requestlog [None req-363951a5-33c3-47fe-9620-b8e29558794a tempest-TestVolumeBootPattern-891941578 tempest-TestVolumeBootPattern-891941578] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-710794790" status: 202 len: 0 microversion: 2.1 time: 0.032963 Dec 21 04:47:21.993461 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: [pid: 94299|app: 0|req: 827/1613] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Dec 21 04:47:21 2020] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-710794790 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 21 04:49:06.196817 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:49:06.197331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:49:06 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:49:17.101443 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:49:17.101929 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:49:17 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:50:26.274765 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:50:26.275434 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:50:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:50:27.420389 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:50:27.420870 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:50:27 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:52:26.214411 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:52:26.215042 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:52:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:52:26.588171 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:52:26.588331 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:52:26 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:52:34.817671 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:52:34.818225 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:52:34 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 21 04:52:37.118399 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 21 04:52:37.118807 dv-cinder-733062-17-iscsi devstack@n-api.service[94296]: Mon Dec 21 04:52:37 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!